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Abstract 

The significant progress in constructing graph spanners that are sparse (smah number of 
edges) or light (low total weight) has skipped spanners that are everywhere-sparse (small maxi- 
mum degree). This disparity is in line with other network design problems, where the maximum- 
degree objective has been a notorious technical challenge. Our main result is for the Lowest 
Degree 2-Spanner (LD2S) problem, where the goal is to compute a 2-spanner of an input graph 
so as to minimize the maximum degree. We design a polynomial-time algorithm achieving 



approximation factor 0{A^^^^) « 0{A^-^'^^), where A is the maximum degree of the input 
' graph. The previous 0(A^/^)-approximation was proved nearly two decades ago by Kortsarz 

and Peleg [SODA 1994, SICOMP 1998]. 

Our main conceptual contribution is to establish a formal connection between LD2S and a 
variant of the Densest k-Subgraph (DkS) problem. Specifically, we design for both problems 
strong relaxations based on the Sherali-Adams linear programming (LP) hierarchy, and show 
that "faithful" randomized rounding of the DkS-variant can be used to round LD2S solutions. 
Our notion of faithfulness intuitively means that all vertices and edges are chosen with proba- 
bility proportional to their LP value, but the precise formulation is more subtle, 
ly^ ' Unfortunately, the best algorithms known for DkS use the Lovasz-Schrijver LP hierarchy 

. in a non-faithful way [Bhaskara, Charikar, Chlamtac, Feige, and Vijayaraghavan, STOC 2010]. 

O^l ' Our main technical contribution is to overcome this shortcoming, while still matching the gap 

that arises in random graphs by planting a subgraph with same log-density. 

X ■ 1 Introduction 



The significant progress made over the years in constructing graph spanners shares, for the most 
part, two features: (1) the objective is to minimize the total number /weight of edges; and (2) the 
techniques are primarily combinatorial. This second feature has started to change recently, with 
the use of Linear Programming (LP) in several results [BGJ+091 IBRRlOl IDKllal iBBM+ll] , One 
of the earliest uses of linear programming for spanners, though, was also one of the few examples of 
a different objective function: in 1994, Kortsarz and Peleg |KP98j considered the Lowest Degree 
2-Spanner (ld2s) problem, where the goal is to find a 2-spanner of an input graph that minimizes 
the maximum degree, and used a natural LP relaxation to devise a polynomial-time algorithm 
achieving approximation factor 0(A^/^) (where A is the maximum degree). They also showed 



*Research supported in part by an ERC Advanced grant. Email: chlamtac@post.tau.ac.il 

^Work supported in part by an Israel Science Foundation grant #452/08, a US-Israel BSF grant #2010418, and 
by a Minerva grant. Email: {michael . dinitz , robert . krauthgamer jOweizmann .ac.il 



1 



that it is NP-hard to approximate ld2s within a factor smaher than J7(logn). We make the first 
progress on approximating ld2s since then, by designing a new approximation algorithm with an 
improved approximation factor. 

Theorem 1.1. For an arbitrarily small fixed e > 0, the ld2s problem can be approximated in 
polynomial time within factor 0(A'^~^^+^) < 0(A°--'^'^^). 

Degree bounds have a natural mathematical appeal and are also useful in many applications. 
For example, one common use of spanners is in compact routing schemes (e.g. |TZ0HlDin07j ). which 
store small routing tables at every node. If we route on a spanner with large maximum degree, then 
a priori the node of large degree will have a large table, even if the total number of edges is small. 
Similarly, the maximum degree (rather than the overall number of edges) is what determines local 
memory constraints when using spanners to construct network synchronizers |PU89j or for efficient 
broadcast |ABP92j . The literat ure on approximation algorithms includes recent exciting work on 
sophisticated LP rounding for network design problems involving degree bounds (e.g. |LNSS09] 
ISEOTl l. 

Dense subgraphs. Our central insight involves the relationship between sparse spanners and 
finding dense subgraphs. Such an informal relationship has been folklore in the distributed com- 
puting and approximation algorithms communities; for instance, graph spanners are mentioned as 
the original motivation for introducing the DENSEST fc-SuBGRAPH (d/cs) problem |KP93j . in that 
case in the context of minimizing the total number of edges in the spanner. Surprisingly, we show 
that there is a natural connection between dA;S and the more challenging task of constructing span- 
ners that have small maximum degree. We prove that certain types of "faithful" approximation 
algorithms for a variant of d/cS which we call Smallest m-EDGE Subgraph (or SmES) imply 
approximation algorithms for ld2s, and then show how to construct such an algorithm for SmES; 
combining these two together yields our improved approximation for ld2s. 

We seem to be the first to formally define and study SmES, although it has been used in previous 
work (sometimes implicitly) as the natural minimization version of d/cS, see e.g. |Nutl01 [GHNROTl 
lAGGNlO] , A straightforward argument shows that an /-approximation for SmES implies an 0(/^)- 
approximation for Dfcs. In the other direction, all that was known was that an /-approximation for 
dA;S implies an 0(/)-approximation for SmES. One contribution of this paper is a non-black box 
improvement: while the best-known approximation for d/cS is 0{n^/^^^), we give an 
approximation for SjnES. This improvement is key to our main result about approximating ld2s. 

LP hierarchies. The log-density framework introduced in [BCC^IO] in the context of d/cS (see 
Section 12.2. ip predicts, when applied to SmES, that current techniques would hit a barrier at 
j^3-2v^^ precisely the factor achieved by our algorithm. Here, the use of strong relaxations (namely 
LP hierarchies) is crucial, since simple relaxations have large integrality gaps. For example, one can 
show that the natural SDP relaxation for SmES has an VL{n^/'^) integrality gap (for G = G{n, n~^/^) 
and m = n^/^), similarly to the r2(n^/^)-gap shown for d/cS by Feige and Seltser |FS97] . 

While we borrow some of the algorithmic techniques developed for Dks by [BCC"'"10] . the crucial 
need for a "faithful" approximation required us to develop new tools which represent a significant 
departure from previous work both in terms of the algorithm and its analysis. For example, our 
algorithm and analysis rely on the existence of consistent high-moment variables arising from the 
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Sherali- Adams |SA90j hierarchy (see, e.g. Lemma [6.3p and not present in the Lovasz-Schrijver |LS91j 
LP hierarchy (which was sufficient for |BCC+inj ). 

Basic terminology. We denote the (undirected]0 input graph by G = (y,E), and let n = \V\. 
For a vertex v £V, let Tg{v) = {u : {u, v} € E} denote its neighbors in G. If the graph G is clear 
from context then we will drop the subscript and simply refer to T(v). Recall that the maximum 
degree of vertices in G is denoted A. We suppress polylogarithmic factors by using the notation 
0{f) as a shorthand for / • (logn)*^^^^ 

As usual, a 2-spanner of G is a subgraph H = {V, Eh) such that every u,v £ V that are 
connected by an edge in G are also connected in by a path of length at most 2. This is a special 
case of the more general notion of a k-spanner, which was introduced by Peleg and Schaffer |PS89j 
and has been studied extensively; see also Section 11.41 



1.1 LP-based approach for ld2s 

The LP relaxation of ld2s used by Kortsarz and Peleg |KP98j is very natural: for each edge 
{u,v} £ E it has a variable x^^^^^y G [0,1], plus additional variables x^u,v};w ^ [0,1] for every 
w £ r(n) n r('y) (i.e., whenever u,v,w form a triangle in G). The objective is to minimize A, 
subject to a degree constraint 

E^,6^(«) ^{u,v} < A yu£V, (1) 

and the constraints that every edge in G (i.e. demand pair) is covered by either a 1-path or a 2-path 
in the spanner (subgraph): 

X{u,v} + T,n,er(u)nr{v) X{u,v}\^ > 1 V{n, v} G E. (2) 
X{u,v};w < min{x{„^^}, V{n, v} £ E, w £ r(n) n T{v). (3) 

This LP relaxation seems like a natural place to start, but it is actually quite weak, having 
integrality gap ^}{^/A). Indeed, let G be a clique of size A + 1; observe that every 2-spanner of this 
G must have maximum degree at least \/A, while the LP has value A < 1 (by setting all x variables 
to 1/A). The same argument works for a disjoint union of n/(A + 1) such cliques. Kortsarz and 
Peleg |KP98| nevertheless managed to achieve 0(A^/^) approximation (in polynomial-time). Their 
algorithm combines a relatively simple rounding of this LP with another partial solution that does 
not use the LP, and whose analysis relies on a combinatorial lower bound on the optimum. 

Our approach is to look at the Kortsarz-Peleg LP above from the perspective of a single vertex 
w. Consider an integral solution H to the LP above, i.e. a valid 2-spanner. From the viewpoint 
of w, incident edges are included in H for two possible reasons: either to span an edge connecting 
two neighbors of w (i.e., including the edges {«, and in order to span the edge {u,v}), 

or to span the edge itself. It's reasonable to focus on the case where H has significantly fewer 
edges than G, and therefore many edges in H are included because of the first reason. Let G^ be 
the subgraph of G induced by the neighbors of w, and let S be the subset of vertices of G^ that 
are adjacent to w in H. Then from the perspective of w, including the edges between w and S 
in H "covers" every demand formed by an edge (of Gy^) that connects two vertices in S, namely 

^Our algorithm for ld2s also works for the directed case, though for simplicity we focus on undirected graphs. 
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E' = {{u,v} £ E : u,v £ S}. We can look at each neighborhood this way, and reinterpret ld2s 
as the problem of covering every demand in at least one neighborhood while minimizing the 
maximum degree. 

This viewpoint naturally suggests an LP-based algorithm for LD2S: solve the Kortsarz-Peleg LP 
above (or some other relaxation), and for every w £ V, interpret Yl{u v}€E-u v&T{w) ^{u,v};w as the 
amount of "demand" that w is supposed to cover locally, and X]uer(u;) ^{w,u} as w's "budget". Then 
for each w £ V run a subroutine that covers the required amount of demand within the budget. 
Since in ld2s every demand must be covered, this subroutine should cover the required amount 
of demand but is free to somewhat violate the budget constraint; the amount of violation will 
correspond to the ld2s approximation guarantee. We thus need to solve the Smallest m-EoGE 
Subgraph (smES) problem: given a graph (in our case Gw) and a value m, choose as few vertices 
as possible subject to covering at least m edges, where an edge is covered if both its endpoints are 
chosen. 

Unfortunately, this reduction from ld2s to SmES does not work. There are two main issues 
with it. First, if w chooses to add an edge to u (i.e. the SmES algorithm at includes u £ T{w)) 
then this increases the degree of both w and u. So even if u stays within its own budget when 
Gu is processed, many of its neighbors might decide to add their edge to u, and the degree at u 
will be very large compared to its budget. Second, since we run a SmES algorithm at each vertex 
separately, they might make poorly-correlated choices as to which demands they cover. This may 
cause a high degree of overlap in the demands covered by different vertices, leading to much less 
total demand covered. Both of these problems stem from the same source: while we used the LP 
to define the total demand and budget at each vertex, we did not require the SmES algorithm to 
act in a way consistent with the LP. If we could force the SmES subroutine to make decisions that 
actually correspond to the fractional solution, then both of these problems would be solved. This 
is our motivation for defining faithfulness. 

1.2 Faithful rounding 

While our formal notion of faithfulness is somewhat technical and depends on the exact problem 
that we want to solve, the intuition behind it is natural and can apply to many problems. Suppose 
that we have an LP in which there are variables {xejeec/ (where C/ is a universe of elements) as 
well as variables {xe^e'}e,e'eu- In our case, each e is a vertex in a s?nES instance (i.e. an edge in 
ld2s) and each pair {e, e'} is an edge in a SmES instance (a 2-path in ld2s). A standard way 
of interpreting fractional LP values is as probabilities, i.e. we think of Xg as the probability that e 
should be in the solution. This interpretation naturally leads to independent randomized rounding, 
where we take e into our solution with probability proportional to Xe- By this interpretation, j;e,e' 
should be the probability that both e and e' are in the solution. But now we have a problem, since 
the natural constraints to force this type of situation in an integral setting, namely constraints such 
as Xe,e' ^ minjxe, Xe'}, correspond poorly to the probabilities obtained by independent randomized 
rounding. For example, if then the LP "believes" that the probability that both e 

and e' are in the solution is x^^e', but under independent randomized rounding this event happens 
with probability ,, which could be much smaller. In a faithful rounding this does not 

happen: roughly speaking, faithfulness requires every element and pair of elements to be included 
in the solution with probability that is proportional to its LP value. 

Many algorithms are naturally faithful, and indeed we suspect that one reason this notion 
has not been defined previously (to the best of our knowledge) is that in most cases it either 
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falls out from the analysis "for free" or it is unnecessary. The connection we show between ld2s 
and faithful rounding for SmES might give one hope that the recent algorithmic breakthrough for 
Dks by Bhaskara, Charikar, Chlamtac, Feige and Vijayaraghavan [BCC"'"10 could imply better 
approximations for ld2s. However, their result heavily uses hierarchies, which creates a formidable 
obstacle for faithful rounding, as we discuss in Section II. 3i 



1.3 LP hierarchies and faithful rounding 

Following the lead of Bhaskara et al. [BCC"'"10] . we employ a strong LP relaxation for SmES, 
which can be viewed as part of an LP hierarchy. In this context, a hierarchy is a sequence of 
increasingly tight relaxations to a 0-1 program, usually obtained via a general mechanism that 
works for any 0-1 program. Such hierarchies (for both LPs and SDPs) have been suggested by 
Sherali and Adams |SA90j . Lovasz and Schrijver [LS91] . and Lasserre [Las02j (in our case, we use 
the Sherali- Adams hierarchy). A key property shared by these hierarchies is that they are locally 
integral; that is, the q-th relaxation in the hierarchy coincides exactly with the convex hull of 
feasible 0-1 solutions, when both are projected onto any g-dimensional subspace corresponding to q 
variables in the program^ Specifically for Sherali- Adams, the q-th relaxation for a given 0-1 linear 
program with variables xi, . . . ,xiy £ {0, 1}, is obtained by extending the 0-1 program to include 
a variable xs for every S C {1, . . . , A^}, \S\ < q, and then writing a "locally integral" relaxation 
for this extended 0-1 program to guarantee that xs = ElieS ^« convention X0 = 1). For more 
details, see the survey |CT12j . 

There has been a recent surge of interest in the study of hierarchies of LPs (or other convex 
programs), especially in connection with approximation algorithms for combinatorial optimization 
problems. Specifically, such strong relaxations can potentially lead to progress on problems whose 
approximability has persistent gaps, such as Vertex-Cover and Minimum-Bisection. This 
line of attack was probably first described explicitly in [ABL02j . However, designing rounding 
procedures for these relaxations is often quite challenging. Indeed, relatively few papers have 
managed to improve over state-of-the-art approximation algorithms using hierarchies. The few 
papers that do give improved approximation bounds using hierarchies include |Chl07l[CS08tlBCG09t 
ICKR101IbCC+10| FI In particular, the last paper designs a rounding procedure for an LP hierarchy 
for d/cS, which we adapt for SmES. 

Our plan is to leverage the success of [BCC"'"10] . but as mentioned before, we face a serious 
obstacle — their rounding procedure is not faithful. They essentially condition on a small set of 
events, for instance that the solution includes a small set S* of carefully chosen elements, and then 
they use only the LP variables for sets containing this S*, namely, a variable xg*ij^y^j is now thought 
of as the LP variable for singleton u. But clearly that variable might have very little to do with 
the actual Xu, which is the quantity with respect to which we are trying to be faithful. 

Our main technical contribution is to overcome this and design a faithful rounding for SmES 
based on Sherali- Adams. Our algorithm is loosely based on the d/cS algorithm of |BCC"'"10| . but 
numerous technical difficulties have to be resolved to make it faithful. This, together with our 
reduction from ld2s to faithful SmES, gives our new approximation algorithm for ld2s. We believe 

^Consequently, if N denotes the number of initial 0-1 variables, then the A'^-th relaxation is exactly the convex 
hull of all 0-1 solutions, i.e., corresponds to solving the 0-1 optimization problem exactly. The g-th relaxation in the 
sequence can be written explicitly as a (linear) program of size N'-'^''\ and thus solved in time N'-'^'^K 

^There are also papers that recover known approximation bounds, say a PTAS, while other ones show the limita- 
tions of these hierarchies by exhibiting integrality gaps for certain problems and hierarchies. 
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that our notion of faithful rounding is of independent interest, and might prove useful for other 
approximation algorithms, especially in the context of using hierarchies such as Sherali- Adams. 

For comparison, we mention that recent algorithmic results, due to [BRSIH IGSllj . design 
rounding schemes for the Lasserre |Las02j hierarchy. Their rounding appears to be faithful (at 
least at an informal level), but it is not applicable to our context. First, their analysis holds 
only for expander-like graphs, and second, their rounding technique applies to problems such as 
constraint satisfaction and graph partitioning, with no connection to dA;S. 



1.4 Related work 

Graph spanners, first introduced by Peleg and Schaffer |PS89j and Peleg and Ullman |PU89] . have 
been studied extensively, with applications ranging from routing in networks (e.g. |AP951 iTZOSj ) 
to solving linear systems (e.g. |ST04t IEEST08] ). The foundational result on spanners is due to 
Althofer, Das, Dobkin, Joseph and Soares [ADD"*" 93 , who gave an algorithm that, given a graph 



and an integer A: > 1, constructs a {2k — l)-spanner with f^i+i/*^ edges. Unfortunately this result 
obviously does not give anything nontrivial for 2-spanners, and indeed it is easy to see that there 
exist graphs for which every 2-spanner has O(n^) edges, thus nontrivial absolute bounds on the 
size of a 2-spanner are not possible. Kortsarz and Peleg [KP94j were the first to consider relative 
bounds for spanners. They gave a greedy 0(log j-El/iyD-approximation algorithm for the problem 
of finding a 2-spanner with the minimum number of edges. This was then extended to variants of 
2-spanners, e.g. client-server 2-spanner |EP01j and fault-tolerant 2-spanner [DKllal IDKllbj (for 
which only O(logA) is known). All of these bounds are basically optimal, assuming P ^ NP, due 
to a hardness result of Kortsarz [KorOl] . 



1.5 Outline 

We begin in Section [2] by giving a high-level overview of our reduction from ld2s to SmES and our 
faithful rounding for SmES. This overview is not technically accurate, but provides a simplified 
algorithm and analysis in order to provide the intuition behind our approach. In Section [3] we 
give a formal description of the LP relaxations for both problems. In Section [J] we give the details 
behind our reduction. Section [5] contains preliminaries for our SmES rounding algorithm, while the 
algorithm itself can be found in Section [H and the analysis is in Section [71 Finally, we conclude 
with a discussion of future directions Section [HI 



2 Overview of our approach 

2.1 Overview of LP relaxation for ld2s and reduction to SmES 

In this section we give an LP relaxation for ld2s that uses a relaxation of SmES as a black box, 
as well as an algorithm that shows how to use a faithful rounding for SmES to approximate ld2s. 
Both the relaxation and the algorithm presented here are simplifications that ignore some technical 
details; the full relaxation and algorithm, as well as all proofs, can be found in Sections [3| and [H 

We will actually give a relaxation for a slightly more general version of ld2s in which instead 
of spanning all edges we are given a subset E <^ E and are only required to span edges in E. Note 
that the optimal solution for demands E ^ E has maximum degree that is at most the maximum 
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degree of the optimal solution to the original ld2s problem (where all edges are demands). This 
will allow us to cover some demands, re-solve the LP with only the remaining demands, and repeat. 

Our relaxation is a feasibility LP, so we will guess the optimal degree bound A and use it as a 
constant in the LP. For each u £ V, let G„ = {Vu,Eu) be the induced subgraph of {V, E) on Tg{u). 
Our relaxation includes a fractional SjnES solution for each Gu- let SmES-LP(GM) be a linear 
relaxation of SmES with variables {z'^}vi^Vu U {^e}e£Eu with the property that z'^^ ^| < min{z^, z"} 
for all {w, v} G E^. In a 0-1 solution this means an edge is covered only if both of its endpoints are 
chosen. Any polytope that includes this basic condition can be used, but obviously the tighter this 
relaxation is the tighter our ld2s relaxation will be, and in the end we will use a much stronger 
relaxation for SmES that is based on the Sherali- Adams hierarchy. 

Our relaxation for LD2s with demands E <^ E is given by (j4])-([7]). 



(«).ey{G„),(^e)e6i?(G„)) ^ SmES-LP(G„) 
max{z",2;^} < X{u,v} 

^ X{u,v} < A 
X{u,v} + X] ^{u,v} = 1 

wer{u)nr{v) 



y{u,v} G E 
y{u,v} G E 



(4) 
(5) 
(6) 

(7) 



Constraint JH) requires that for each neighborhood graph Gu there is an associated fractional 
SmES solutiono Constraint ([5]) simply requires that for each edge, if either of the SmES instances 
at its endpoints include it in their solution then we include it in the overall solution. Constraint ([6]) 
gives the degree bound, and ^ is the main covering constraint, requiring that every demand is 
either included or is spanned by a 2-path. It is easy to see that this is a valid relaxation for ld2s: 
if we are given a 2-spanner H oi G with maximum degree at most A, for every edge {n, f } G E{H) 
we set X[u,v} = 1 and z^ = 1 and = 1. For every edge {n, v} € E \ E{H) we arbitrarily choose 
some w ^ V so that {w, w} G E{H) and {w;, f } G E[H) (some such w must exist since H is a, 
2-spanner) and set = 1- All other variables are 0. 

We now show that it is sufficient to design a rounding scheme for SmES that is faithful according 
to the following definition. Given a graph G, let C{G) be an LP that has a variable Qu for every 
u G V{G) and a variable Ce for every e G E{G) (we will later instantiate C{G) as various LP 
relaxations of SmES). 

Definition 2.1. A randomized rounding algorithm ^ is a factor f faithful rounding for C{G) if, 
when given a valid solution {{Cu)ugVi (Ce)eeE) to J~-{G), it produces a randomized (not necessarily 
induced) subgraph H* = (V*,E*) such that 

1. Pr[v eV*]<f-Cv for all v G V{G), 

2. Pv[{u,v} G E*] < C{u,v} for ah {u,v} G E{G), 

3. \V*\ < f ■ J2veV{G) (with probability 1), and 

4. E[\E*\]>n{Z{uMeEiG)C{u,v})- 



''Our actual relaxation (Figure [3]) has a collection of SmES instances for each neighborhood graph based on the 
possible degrees in a bipartite decomposition of an optimal solution, and we allow the LP to fractionally "guess" 
which of these instances to use. 
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Observe that if algorithm ^ is a factor / faithful rounding for a relaxation of SmES then it is 
also an /-approximation in the usual sense, simply by conditions [3] and S] (up to a polylogarithmic 
loss in the amount of edges covered). The converse, however is not true: many rounding algorithms 
that give an /-approximation are not faithful, including jBCC"'"10] . 

We now show that if we are given an algorithm A that is a factor /(n) faithful rounding for 
SmES (where n is the number of vertices in the SmES instance), there is an 0(/(A))-approximation 
algorithm for ld2s that uses algorithm ^ as a black box. The reduction is given as Algorithm [TJ It 
begins with all edges as the demand set E, and first solves the LP relaxation for ld2s with demand 
set E. It adds every edge that has x value at least 1/4, and then uses algorithm A to round each 
of the \ V\ SmES instances in the relaxation. At the end of the loop it updates the demands E by 
removing edges that were successfully covered by this process, and repeats. Note that the edges 
covered by the SmES roundings are used only in the analysis; in the algorithm we take the vertices 
output by each SmES solution and include the appropriate edges in our spanner. 

Algorithm 1: Approximation algorithm for ld2s 
Input : Graph G = {V,E), degree bound A, factor f{n) faithful rounding algorithm A for 

SmES 

Output: 2-spanner H = {V,Eh) of G 

1 E ^ E, Eh ^ ^ 

2 while / do 

3 Compute a valid solution (x, z) for LP ([l])-([7]) on graph G with demands E 

4 E^ ^ {e £ E : Xe > 1/4} 

5 foreach u ^ V do 

6 H* <^A{Gu,z^) ; // output of SmES rounding A 

7 \_Eu^{{u,v}eE:veV{H*)} 

// Add all edges found in above rounding 

Eh^EhUE^U (U„6y Eu) 
II Remove satisfied demands 

E ^ E \ [Eh U {{u,v} :3w eV s.t. both {u, w}, {w, v} G Eh}) 



Theorem 2.2. Let algorithm A be a factor f{n) faithful rounding for SmES (where n is the number 
of vertices in the SmES instance). Then there is a (randomized) 0[f [IS))- approximation for ld2s. 

Proof. We provide only a sketch of the proof; details can be found in Section |4l We may assume that 
our ld2s algorithm guesses some A S [OPT, 2- OPT] simply by trying the 0(log A) relevant values 
and reporting the best solution. In this case, LP ([4])-(I7]) is guaranteed to have a feasible solution. 
We now use Algorithm [1] with this value of A. It is easy to see that each iteration of the loop only 
increases the maximum degree by 0(/(A)) • OPT: adding edges in Ex only costs a constant factor 
more than the fractional solution. Definition I2.1ll3| ) implies that rounding the SmES solution at u 
only increases the degree of u by /(|Kj|) • OPT < /(A) • OPT, and Definition I2.1I |T|) implies that 
rounding the SmES solution at neighbors of u only increases the degree of u by 0{f{\Vu\)) ■ OPT 
(with high probability). 

So we just need to show that the number of iterations is (with high probability) at most 0(1). 
To do this we prove that in every iteration the expected number of satisfied demands is at least 
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This is clearly true if \Ex\ is large. If \Ex\ is small, then summing ([7|) over all G E 

implies that the total amount of demand covered by SmES instances (i.e. the z variables) is large, 
say r2(|S|). Now Definition 12. guarantees that when we round an instance we still cover almost 
as much demand as the LP (up to a polylogarithmic factor), and Definition 12. ll |2|) implies that this 
coverage is spread out among the demands in a way that corresponds to the LP. This, together 
with ([7|), implies that the total coverage is large but no edge is "overcovered" . Thus while we 
cannot guarantee that every demand is covered with high probability in each iteration, an averaging 
argument guarantees that many demands are covered with reasonable probability. This is enough 
to give the expected amount of coverage that we need. □ 

2.2 Overview of our faithful rounding algorithm for SmES 

In this section we describe our faithful factor n^-Sv^+e rounding algorithm for SmES. While the 
description of the full algorithm is rather lengthy, and therefore deferred to Sections [5l [6l and [71 
we give a high-level overview (with some technical details) and concentrate on a special case which 
illustrates the main ideas in the algorithm and its analysis. 

2.2.1 Densest ^-Subgraph and the log-density framework 

We follow the framework introduced in [BCC"'"10] . They begin by defining the notion of log-density 
of a graph as log„(-Davg)) where -Davg is the average degree and n is the number of nodes. They 
then asked the following question: how hard is it to distinguish between 1) a random graph, and 
2) a graph containing a subgraph with roughly the same log-density as the first graph? 

More formally, they pose the following Dense versus Random promise problem, parameter- 
ized by k and constants < a, /3 < 1: given a graph G, distinguish between the following two 
cases: 

1. G = G{n,p) where p = 7i"~^ (this graph has log-density concentrated around a). 

2. G is adversarially chosen so that the densest fc-subgraph has log-density /3 (where k^~^^ ^ pk). 

For certain ranges of parameters, it seems quite challenging to efficiently distinguish when 
/3 < a. In fact, the following hypothesis is consistent with the current state of our knowledge: 

Hypothesis 2.3. For allO < a < 1, for all sufficiently small e > 0, and for all k < y/n, we cannot 
solve Dense versus Random in polynomial time (w.h.p.) when (3 < a — e. 

The above hypothesis (if true) has immediate implications for the hardness of approximation 
of both Dks and SmES. Concretely, for SmES, let m = k^~^^ be the number of edges in /c-subgraph 
in the second case. We know that in the first case w.h.p. the smallest m-edge subgraph has size at 
least r2(min{m, V mn^~'^}). Thus, if we could achieve approximation ratio <^ A;/min{m, V mn^~"}, 
this would refute Hypothesis 12. 31 for the corresponding parameters. For k = n^~^ and a = \/2— 1, 
the hypothesis implies that there exists no n^^^^~^-approximation for S?nES. 

While |BCC^10| matches the gap predicted by the log-density model for Dks with an n^/'^+^ 
approximation for d/cS (even for general graphs), we also match the predicted gap for SmES with 
an n^~^^+^-approximation for SmES. 
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2.2.2 Parametrization and simplifications 

In order to achieve a faithful rounding, we will make certain assumptions (which we later justify) 
about the structure of the intended solution to the LP relaxation. In particular, we will assume 
that the subgraph represented by the solution is regular, and that we are allowed to "guess" the 
size of the subgraph, k, and the degree in the subgraph, d, thus m = Q{kd) (see Section [3.ip . 

We also make the following simplifying assumptions. Let / = f{n,k,d) be the intended ap- 
proximation factor, which will be determined shortly. We may assume that f < d, since it is easy 
to achieve a faithful 0((i)-approximation (see Appendix |A]). We also assume that the maximum 
degree in the input graph is at most D = nd/{kf'^) (see Appendix [B]) . 

Finally write a = log„(D), and define our intended approximation / implicitly as the value 
which satisfies / = (together with the definition of D we can derive an explicit 

expression for a and /). Note that maximizing this expression over a G [0, 1] shows that / < n^^"^^. 

2.2.3 LP relaxation and faithful rounding for S?nES 

With the previous assumptions in mind, we have the following feasibility-LP relaxation (simplified 
for this overview) which is implied by q rounds of Sherali- Adams, with variables {zt \ T C V L) 
E, \T\ < q} (in the intended 0-1 solution, zt = 1 and only if all vertices and edges in T are in 
the subgraph): 

zj^yj^^^ =kzT \iT (lVUE,\T\<q-l (8) 

^ ztvj{u} = dzT VT c y u |r| < g - 1, Vw G r n y (9) 

ner(t)) 

ZT = ^Tu{n} = 2tu{.} = ^Tu{n,.} \IT d VVJ E , \T\ < q - 2, V{tx, v}eTr\E (10) 

< ZT < Zy/ < Z0 = 1 \/T' CT (11) 

The algorithm in its full generality is based on the caterpillar structures introduced in jBCC"'"10] 
(where the caterpillar structure depends on a) . Let us concentrate here on the case where a = 1/s 
for some (fixed) integer s > 0, in which case the caterpillar is simply a path of length s. At its core, 
the algorithm (for this value of a) relies on an LP-analogue of the following combinatorial argument. 
Fix a vertex vq in the optimum subgraph. For all t = 1, . . . , s, let Pf° be the union of all (possibly 
self- intersecting) paths of length t in the subgraph starting at vq, and let be final endpoints 
of those paths. Note that \V^°\ = d and that < A: = = ^ • n^"" = = d/^-i. 

Therefore, there must be some t £ {1, . . . , s — 1} for which |V^+i|/| V^'"'] < /• Now consider the 
subgraph at this step = {Vi"° ,Vf"J^^, {{vt,vt+i} \ 3vo — . . . — vt — vt+i £ -Pj+i})- Since the 
vertices in V^" all have degree d, the average degree of vertices in V^_^i is at least d/ f. It turns out 
that even without access to the optimum subgraph we can isolate a subgraph with average degree 
at least d/f and at most kf vertices (this is essentially because by the degree bound, the number 
of vertices at any intermediate stage is at most = n^~" = = k ■ ^ < kf). This essentially 

gives an /-approximation for SmES (since we can repeat until accumulating m edges). 

Here we come to the fundamental difficulty in adapting such an approach to achieve a faithful 
rounding. The combinatorial algorithm depends on choosing an initial vertex vq which is actually 
in the optimum subgraph. The analogous LP-rounding algorithm uses the LP values "conditioned 
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on choosing vq" , that is, values of the form Zg^J^^gj/zvQ instead of the original zs variables (where 
S corresponds to one or more vertices/edges along the path). However, it is the zs variables (in 
particular for singleton sets S representing one vertex or one edge) which we want to be faithful to 
in our roundingO Unfortunately, these two LP solutions might be almost completely unrelated. 

To overcome this difficulty, we use a somewhat elaborate bucketing scheme, to ensure that all 
the relevant LP values are reasonably uniform, as follows. Denote by the set of all length t 
paths in the graph starting at vertex v, and by Zp the variable for a path p (i.e., zt where T is the 
set of edges and vertices in p, or by Constraint (fTT]l . T could equivalently be just the edges in p). 
The core of the analysis of the LP-analogue relies on the equality 

obtained by Constraint ^ and repeated applications of but in fact it can use any set of 
length-s paths V for which YlpeV ~ ^{kd'^). Thus by partitioning the set of paths into 
buckets and choosing a bucket V with the largest LP value, we can ensure that in every path 
p = uq — ui — . . . — Us in the bucket V certain LP values (like the ones corresponding to entire 
paths, Zp, or the ones corresponding to path prefixes, ^;{{ni_i,ui}|ie[t]} some t £ [s — 1], or to 
vertices in certain positions, z^^^y, or to "conditioned" values, z^u^^u^j/z^u^y) are all independent of 
the choice of path (up to a constant factor). In other words, within the bucket V (say, vertices ut 
for a fixed t € {0, . . . , s}), the corresponding LP values will be essentially uniform over the choice 
of starting vertex uq and path p. 

Using the uniformity obtained via the above bucketing scheme, we can relate the algorithm 
(which is based on the conditioned LP values) to the original LP values. After some additional 
combinatorial bucketing, we can run the following algorithm: let Vq be the set of starting vertices 
Uq (i.e. paths of length 0) that survive the bucketing, pick a starting vertex uq € Vq uniformly at 
random, and for whichever level t G [s — 1] that gives the approximation guarantee (it can be shown 
that such a t exists), output the level t subgraph = {{uf, ut+i} | 3p = uq — ui — . . . — Us £ 
V}. Since LP values are uniform, the question essentially becomes, how do we guarantee that no 
bucketed vertex (or edge) is chosen with much higher probability than the rest (or the average)? 
This is where we crucially use the regularity Constraint ([9]) (as opposed to, say, a minimum degree 
constraint, as in |BCC^10| ). Roughly speaking, individual vertices and edges cannot be reached 
by a disproportionately large fraction of vertices uo €Vo, because then the relative total LP weight 
of the corresponding paths (to such a vertex or edge) would exceed d*. 

For the sake of concreteness, let us consider one specific aspect of faithful rounding: the prob- 
ability with which the level t vertices ut are chosen. Let Vt be the set of length t prefixes of paths 
in V, let be the set of paths in Vt that start with the vertex uq G Vq, and let Vt (resp. Vt°) be 
the set of level t endpoints of paths in Vt (resp. in Vf"). By the approximation guarantee (via an 
LP analogue of the above combinatorial argument), we have 

\Vt°\<fk. (12) 

Suppose the bucketing also ensures that every uq E Vq and ut E V"" are connected by roughly 
the same number of Vt paths (up to a constant factor), which we denote by h. Also, suppose the 
cardinalities |V""| are roughly uniform for different choices of uq. Then, abusing notation, we can 

^This problem is only exacerbated in the general case, when the caterpillar has additional leaves to condition on. 
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write the number of paths as \Vt\ ~ |Vo| • | ° | • h, and in particular, the total weight of paths p G Vt 
is -ZplVol • |V"°| • h « fed*. Now, by repeated applications of Constraint ([9]), we have that the total 
weight of paths leading to a specific vertex ut £ Vt is 2p|{uo I 'Ut S < Zufd!' (note that this 

argument reverses the direction of paths in the algorithm and so crucially depends on the existence 
of consistent high-moment Sherali-Adams variables, which are not present in the Lovasz-Schrijver 
hierarchy used in jBCC"'"10] ). Combining this with the (approximate) equality above, we can bound 
the probability that a vertex ut is included in the output (the level t subgraph) as 

|Vo| Zph\VQ\ k 



3 LP relaxations 

In this section we develop the basic LP relaxations that we will use, both for SmES and for ld2s. 
We begin with SmES, since we will need the LP we develop in order to define the LP for ld2s. 



3.1 LP relaxation for SmES 

It turns out that it is easier to develop faithful rounding algorithms for S?nES if we make certain 
simplifying assumptions. Namely, we would like to assume that the input graph is bipartite, and 
that the optimal solution is nearly-regular (vertices on the same side of the bipartition have degree 
within an O(logn) factor of each other). These assumptions will affect our relaxation, so we 
discuss them here. Since these assumptions involve manipulations of the optimal (or at least an 
unknown) subgraph, one should view these as a thought experiment which justifies the correctness 
(i.e. feasibility) of our relaxations. 

Formally, we define nearly-regular as follows: 

Definition 3.1. A bipartite graph G = {Uo,Ui, E) is called {kQ,ki, do, di) -nearly regular if for 
every b £ [2] we have \Ub\ = kh and the following condition on the degrees holds: 

db > max deg(?Xf,) > min deg(nb) > ^{dh/ logn) 

By convention, we will assume that ko > ki, which implies that di > il((io/ log n). 

The next lemma shows that any graph H can be changed into a nearly-regular graph with 
almost the same number of edges. In particular, any dense subgraph H can be made nearly regular 
without losing too much in the density. 

Lemma 3.2. Given an arbitrary graph H = {V,E) on n vertices, there exist values /cq, A;i, do, di 
and disjoint vertex sets Uq, Ui '^V with the properties that the induced bipartite subgraph H' of H 
on (Uq,Ui) is (kQ,ki,dQ,di) -nearly regular and also has \E{Uo,Ui)\ > il(l/log^ ?i)|-E|. 

Proof. First, note that a random cut in the graph gives a bipartition which preserves at least half 
the edges (in expectation). Thus there exists a bipartition (Vo,Vi) with |£^(Vo, Vl)| > 1-^1/2- For 
the rest of the proof we will only use these edges between Vq and Vi. Now, partition the vertices 
in Vq into logn buckets by degree (into Vi), where in each bucket, degrees vary up to a factor of 
at most 2. Let Uq be the bucket which sees the most edges (at least |ii'|/21ogn). Let do be the 
maximum degree in Uq. Note that the average degree in Uq is at least do/ 2. 
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Now partition the vertices of Vi into buckets by their degree into Uq . Let Ui be the bucket with 
the largest number of edges into Uq (at least |£^|/21og^ n). Let di be the maximum degree (into Uo) 
in Ui, and note that the average degree in C/i is at least di/2. Since the number of edges in this step 
went down by a most a logn factor, the average degree in Uq (into Ui) is at least do/ (2 log n). If 
we now iteratively remove every vertex in Uq with degree (into Uq) at most (io/(6 log and every 
vertex in Ui with degree (into Uq) at most di/G, then it is easy to see that at least a 1/3- fraction 
of the original edges in E{Uo, Ui) remains, and this final step guarantees the regularity conditions 
on both sides. □ 

Before defining our relaxation for general graphs, let us first define a feasibility LP relaxation 
for the decision problem of whether, given a bipartite graph G' = {Vo,Vi, E), the graph contains 
a {ko, kijdo, (ii)-nearly regular subgraph, with ko vertices on the Vq side, and ki vertices on the Vi 
side. For any integer q, let Tq = Tq{G') = {T C VqUViLI E' : \T\<q}. 

We denote by Bipartite-SmES-LPg(G', /cqj ^i, f^^Oj c^i) the set of solutions to a feasibility LP 
given by Constraints ([13]) -([16]), over the variables {yT)T&Tqi as depicted in Figured] These con- 
straints are actually implied by q rounds of Sherali- Adams applied to a basic SmES LP that has 
variables for all vertices and edges. 

Figure 1: Relaxation Bipartite-SmES-LPq(G', fco, fci, do, di) on variables {yT)T<^Tq 

J2 y^^i-} = ^bVT Vfe G {0, 1}, VT G Tq-i (13) 

^{yk^)dhyT< yTvj{{u,v}} < dbVT V6G{0,l},VrG Vi,Vt;Grnyfe (14) 

u&{v) 

VT = VTuiu} = vtum = yTu{u,v} VT G 7;_2,v{u,w} G r (15) 

< < yr' < 1 VT' C T G 7^ (16) 



Remark. Normally, such an LP also includes the normalization ?/0 = 1. However, for our intended 
usage of this LP, namely for ld2s, it will be important to leave this variable unconstrained, except 
for the upper bound given by (llOp . But when we round this LP we will be able to assume that 
2/0 = 1; whenever we choose to round it we will also scale it by 1/^0. Thus when we consider faithful 
rounding algorithms for this LP we will always be assuming that y0 = 1. 

Remark. This LP has size (variables and constraints) at most vP^'^\ because the number of 
variables is dominated by 0{\Tq\), and the number of constraints is dominated by 0{\Tq\^). 

Notice that according to Constraint (|15p . an edge is covered if and only if both endpoints are 
chosen and we decide to take the edge. For example, it is feasible to have yju} = yj^,} = y[u,v} = 1 
(i.e. both u and v are chosen) but y\^[u,v}} = V{u,v,{u,v}} = (i-^- for some reason the LP does 
not count this edge as being covered). Normally for covering problems such as SmES there is no 
reason not to include an edge if both vertices are included, but because of how we use SmES in our 
algorithm for ld2s it will be important for us to be able to include two vertices without necessarily 
covering the edge between them. 
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Observe that if G' contains a (A;o, ki, do, (ii)-nearly regular subgraph H, then the above LP has 
a feasible solution that corresponds to H in the sense that t/t = 1 if and only if every vertex and 
edge in T is present in H (and = 1). 

Now, consider a (not necessarily bipartite) graph G. Lemma 13.21 implies that for any subgraph 
H oi G there is a nearly-regular bipartite subgraph of H with almost as many edges. However, 
since we do not know a priori the bipartition of the subgraph (or any bipartition of G which is 
consistent with it), we write a "container" LP whose purpose is to essentially assign sides, and to 
interface cleanly between the bipartite SmES relaxation, and the relaxation for ld2s. In brief, with 
every vertex E y, we associate at most one of two assignments, which we label (?;, 1) and (v, 2). 
Thus, every edge {it, v} can participate in the subgraph as (at most) one of two possible "assigned" 
edges {(«, 1), (f,2)} and {(u, 2), {v, 1)}. We can think of these as forming a bipartite graph B{G) 
with vertices V x [2] and edges {{u, 1), (v, 2)} and {(u, 2), {v, 1)} for every {it, v} G E. The induced 
nearly-regular bipartite subgraph H' of G that is guaranteed to exist by Lemma 13.21 corresponds 
to an induced subgraph of B{G) in which for every vertex v in H' either (v, 1) or (v, 2) is included 
(depending on the side of v in H'). Note that for every vertex (or edge) in H' , there is exactly one 
vertex (or edge) in the corresponding subgraph of B{G). 

It will be easier to describe our algorithm and analysis for s?nES using the LP for bipartite 
graphs, but in order to interface with the ld2s LP we will use the above discussion of B{G) to 
write a container or wrapper LP. Denote by SmES-LPg(G, /cq, do, di) the set of solutions to 
the feasibility LP depicted in Figure [2] on the variables {za)a&vvjE and Z0 (in other words there is 
a z variable for every vertex and edge in the original graph, as well as one extra z variable for the 
empty set). Notice that this LP has auxiliary variables of the form y-p. 



Figure 2: Relaxation SmES-LPg(G, /cq, ^i, ^^o, c^i) on variables {za)a^vvjEvj{%} 



^{yT)T(i%{B(G)) G Bipartite-SmES-LP^(5(G), A;o,^i,c^o,c?i) s.t. 

z% = y% (17) 

y{ {«,!)} + ?/{(«,2)} =Zu<Zfli Mu^V (18) 

2/{{(«,i),(f,2)}} + y{{(«,2),(i;,i)}} = < Zu, Zy V{n, v} E (19) 



It is easy to see that for any (A;o; ^ij f^O) c^i)-nearly regular bipartite subgraph H of G, if we 
set Zu = 1 for u € y{H) and Ze = 1 for e G E{H) then we can set the y variables in a 
way corresponding to the associated subgraph of B{G), giving a valid solution. For any tu- 
ple of parameters r = {ko,ki,do,di) let SmES-LPJ(G) = SinES-'LPq{G,kQ,ki,dQ,di) and let 
Bipartite-SmES-LPJ(G') = Bipartite-SmES-LPg(G', /cqj ^i; c^O; t^i)- By construction, a faith- 
ful rounding for Bipartite-SmES-LPg(i?(G)) (according to Definition 12. ip implies a faithful al- 
gorithm for SmES-LPg (G); we now prove this. 

Lemma 3.3. For any graph G and parameters r, if we have a factor f faithful rounding algo- 
rithm for Bipartite- SmES-LP^{B{G)) then we have a factor f faithful rounding algorithm for 
SmES-LPl{G). 

Proof. Let algorithm ^ be a factor / faithful rounding for Bipartite-SmES-LPg(i?(G)). Then 
our algorithm for rounding SmES-LPg(G) is simple: we first find the associated y variables (if 
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they are not already given to us), and then run algorithm A on the associated y variables to get 
{V*,E*). We then include a vertex v in V* if V* includes either {v,l) or (f,2), and include an 
edge {u,v} in E* if E* includes either {{u, l){v,2)} or {{u,2), {v, 1)}. 

Then Pr[u G V*] < f ■ y{(y^i)} + / • y{{v,2)} = f ' ^v, satisfying the first part of the definition. 
And Pr[{u,v} G E*] < y{{{u,i),{v,2)}} + y{{{n,2), {«,!)}} = H^M^ satisfying the second part. For the 
third part, we know that \V*\ is (with probability 1) at most / • X^t,gv'(G)(y{{»',i)} + y{{v,2)}) = 
/ • J2v(^v{G)^v vertices, and clearly \V*\ < \V*\. Finally, we know that E[\E*\] > E[\E*\]/2 > 

^iYl{u,v}eEiG)iy{{(u,l),{v,2)}} + y{{{u,2),(v,l)}})) = ^iYl{u,v}eE{G) H^M^ ° 

3.2 LP relaxation for ld2s 

Now we show how to use this s?nES LP to give an LP relaxation for ld2s. We will actually give a 
relaxation for a slightly more general version of ld2s in which instead of spanning all edges we are 
given a subset E <^ E and are only required to span edges in E. Note that the optimal solution 
for demands E C E has maximum degree that is at most the maximum degree of the optimal 
solution to the original ld2s problem (where all edges are demands). This will allow us to cover 
some demands, re-solve the LP with only the remaining demands, and repeat. 

Since we construct a feasibility LP we will guess the optimal degree bound A, so we will be 
able to treat it like a constant (rather than a variable). For each u £V, let G„ = (Vu,Eu) be the 
induced subgraph of {V, E) on Tq{u), i.e. Gu has vertex set Tg{u) (the neighbors of u in the overall 
graph) and edge set E restricted to Tg{u). The core of our relaxation is a decomposition of one 
SmES instance into many SmES instances. In particular, the following lemma will be useful: 

Lemma 3.4. Given a graph G = iV, E) on n vertices and a value X, there is a multiset of size 
at most O(n^log^n) consisting of tuples {kQ,ki,do,di) so that every subgraph of G with at most A 
vertices can be decomposed into O(log'^n) nearly-regular subgraphs with parameters from L^. 

Proof. Let H he a subgraph of G with at most A vertices. We know from Lemma 13.21 (applied to 
H) that there exists some r = {ko,ki,do,di) and subgraph H' of H so that H' is nearly-regular 
with parameters r and the number of edges in H' is at least an 0(1/ log'^ n)-fraction of the number 
of edges in H. We can now remove the edges in H' from H and repeat this process. Since there 
are at most edges initially, we can repeat this step only 0(log^ n) times. Note that this bound is 
independent of the graph H that we are decomposing. H simply affects which tuples are produced 
by the decomposition. But no matter what H is, obviously ko,ki,do,di are all at most A < n. 
Thus there are at most distinct tuples. So we simply define the multiset to contain 0(log^ 



n 



copies of each such tuple, for a total size of 0(n log n). □ 

This decomposition lemma will allow us to cover all demands in our relaxation, even using the 
nearly-regular assumption in the SmES relaxation. More formally, for ld2s we have the feasibility 
LP depicted in Figure [3] with the degree bound A being treated as a constant. 

Remark. This LP has size (variables and constraints) nP^'^\ so can be solved in polynomial time 
for constant q. Indeed, for each u £ V there are \L^\ = O(n^) different ISmES-LPJ programs. 
Each such program has rP^'i^ variables and constraints, and in addition there are 0{n ) variables 
of the form and O(n^) new constraints (I2ip -( l25]l . 
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Figure 3: Relaxation LD2S^(G,£^) 



(^0'",(^r).eV(G.),(^e'")e6i?(G„)) ^ SmES-LP;(G„) 




(20) 


5^ z;'^<0(log3A) 




(21) 








V zj;'- + V zY < 0(log3 A) • 


V{u,u} G 


(22) 
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(23) 


v£T{u) 






X{u,v} + Y Yl ^TuM = 1 


V{n, u} G 


(24) 


«>Gr(M)nr(i)) reL^ 






< X|„ „| < 1 


y{u,v] G £^ 


(25) 



Lemma 3.5. The feasibility LP (j20p -(j25 p is a valid relaxation of lb2s with degree bound A and 
demands E E. 

Proof. Let G = {V, E) be a graph, and let H = (V, Eh) be a subgraph of G that is a valid 2-spanner 
and has maximum degree A < A. We construct an LP solution as follows. For each {it, v} G E, set 
^{u,v} = 1 if {^i, "y} G Eh and set X|„ = otherwise. Note that Constraint (j23p is satisfied. For 
every edge {u,v} & E \ Eh, there is at least one 2-path between u and v in H, since is a valid 
2-spanner. Let w{u, v) be the center vertex of such a path, choosing one arbitrarily if there are 
multiple 2-paths. For every vertex w € V, we define the graph H^j to be the subgraph of G^ with 
vertex set {u G T{w) : {u, w} G Eh} and all edges {u, v} with the property that w{u, v) = w (note 
that this also implies that x^^^.v) = 0)- We know from Lemma 13.41 that H^] can be decomposed 
into O(log'^A) nearly-regular graphs with parameters from (here A has replaced n because 
Hyj has only A vertices). Let the multiset C contain the parameter tuples r used in this 
decomposition, and for r G L'^ let H'^ be the graph from the decomposition. Then for each r G L'^ 
we set z^'^ = 1, and we set zjf'^ = 1 if and only if u G V{H^) and set z^^^^y = 1 if and only if 
{u,v} G E{H^). All other variables are 0. In particular, for r ^ L', even z^'^ = 0. 

Let us now prove that all the constraints are satisfied. Constraint (I20p is obviously satisfied, 
since for any u £ V and t £ L'^ the variables in the SmES LP are either all or are integer variables 
corresponding to r-nearly regular subgraph. Constraint (f2T]) is satisfied since \L'J\ < O(log'^A), 
and if T ^ L„ then z^'^ = 0. Similarly, Constraint (j22p is satisfied since |-L^| and are both at 
most 0(log^ A) (and thus the left hand side is at most 0(log^ ^))) arid if any one of the variables 
on the left is 1 then the edge {u,v} is present in Eh and thus Xj^^.v) = 1- Finally, Constraint ()24p 
is satisfied because for every edge {n, f } G E, if {n, u} G Eh then x^u,v} = 1 and {n, u} does not 
appear as an edge in any SmES instance, so the left hand side of the constraint is 1. Otherwise 
^{u,v} = 0) ill which case {n, v} G E[w(u,v) but is not in any other SmES instance. Since we decompose 
Hw{u,v), there is exactly one r that covers {u^v} and for which the corresponding z^^^y = 1, and 
thus the left hand side is again 1. □ 
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4 Reduction of ld2s to faithful roundings of SmES 



We now show that if we are given an algorithm A that is a factor / faithful rounding for SmES-LPq(G) 
(even restricted to the case when Z0 = 1), there is an 0(/(A))-approximation algorithm for ld2s 
that uses algorithm ^ as a black box. Lemma [3.31 then implies that it is sufficient to be faithful for 
Bipartite-SmES-LP^(i?(G)). Our reduction is given as Algorithm [2l which is relatively simple. 
It begins with all edges as the demand set E, and first solves the LP relaxation for ld2s with 
demand set E. It then adds every edge that has x value at least 1/4. Then for every SmES instance 
in the relaxation it flips a coin, and with probability proportional to zij) (for that instance) scales all 
y variables for that instance by a factor of 1 /zi^f and then uses the SmES algorithm on the instance. 
After this is completed we update the demands E by removing edges that were successfully covered 
by this process, and repeat. 

Algorithm 2: Approximation algorithm for ld2s 
Input : Graph G = {V, E), degree bound A, factor / faithful rounding algorithm A for 
SmES-LPg(-) 

Output: 2-spanner H = (VjEh) of G with maximum degree A 

1 Let E i— E (unsatisfied demand edges) 

2 Let Eh ^ (spanner edges) 

3 while / do 



4 
5 
6 
7 
8 
9 

10 
11 

12 
13 



Compute a solution (x, z) for LP LD2Sg {G, E) from Figure [3] 
E^^{eeE:Xe> 1/4} 
foreach u G y, r G do 
with probabiUty 

Hu,T ^ A{Gu,{zl''' /zl''']i,(,v{Gu)vJE{Gu)) ; // output of SmES rounding 

Eu,r^{{u,v}CiE:vCiV{Hu,r)] 
else (with remaining probability) 

L Eu,r ^ 

// Add all edges found in above rounding 

Eh^EhDE^U (U^ev- UrGL^ Eu,r) 

II Remove satisfied demands 

E ^ E \ [Eh U {{u, v} -.^w s.t. both {u, w}, {w, v} G Eh]) 



Theorem 4.1. Let algorithm A he a factor f faithful rounding for SmES-LP'^{G) with 2:0 = 1. 
Then there is a (randomized) 0{f {A)) -approximation for ld2s. 

Proof. We may assume that our ld2s algorithm has a valid guess for A = OPT by simply trying all 
A relevant values and reporting the best solution. In this case, the linear program LD2S^(G,^) 
is guaranteed to have a feasible solution for any E <Z E. We now use Algorithm [2] with this value 
of A. The proof has two parts: first, we show that in each iteration of the main loop, with high 
probability the set of edges added to Eh (namely E^ U (UueV Utgl^ -E^u.t) ) forms a subgraph with 
maximum degree at most 0(/(A)) ■ A. Second, we show that with high probability there are only 
0(1) iterations of the main loop. Clearly these together prove the theorem. 
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We begin by analyzing the cost (i.e. maximum degree) of a single iteration of the main loop. 
Let It € 1^ be an arbitrary vertex; we will show that at most 0(/(A)) • OPT edges were added 
incident to it. There are three types of edges incident to u that are added: these in E^, those in 
Eu,T for some r, and those in E^^^ for some neighbor v of u and t ^ L^. For the first type, the 
number of edges in E^ incident on u is at most \{v G r(ti) : > 1/4}| < Yl,vi^T{u) ^^{u,v} ^ 4A, 

where we used Constraint (I23p to bound the sum. 

For the second type of edges, let be the multiset of parameters from on which we actually 
used algorithm A on u,t (i.e. lines 7 and 8 were executed). Then by Constraint (|2T]l the expected 
size of Lu is at most YIt&l^ ^^''^ — 0{log^n), and since the random coins of algorithm A are 
independent for each r, a simple Chernoff bound implies that this holds with high probability 
(say, probability more than 1 — 1/n^). For each r G the size of Eu^t is equal to \V{Hu^t)\- 
We know from part [3] of the definition of faithful rounding that the size of this set is at most 
/(^) ■ St)6r(u) Constraint (fT3l) from the SmES LP (with T = 0) together with (fT8]l 

implies that this is at most /(A)(A;o + ki) < 2A/(A). Thus the size of Utgl^ ^'^''^ with high 
probability at most 0(log^ n)A/(A) < 0(/(A)) • OPT. 

For the third type of edges, let v G r(u) and r G L-^. Then the probability that {u,v} G E^^j- 
is at most z^''^ {1 / z^''^ ) Zu'^ = Zu'^ , where the first Zg'^ factor is from the probability of applying 
algorithm A to this SmES instance, the (l/zg'^) factor is from the scaling of the variables, and the 
Zu'^ factor is from the definition of faithful rounding. Now (|22p and a simple union bound imply 
that the probability that {u,v} G IJreL^ -^'^.'^ ^® most "^tgl^ ^^'^ — O(log^A) • x^u,v}- This 
is independent for each v G r(n), so by a Chernoff bound we get that with high probability the 
number of type 3 edges is at most 0(log'^ n) Ylv&r{u) ^{u,v} < 0(log^ n) ■ X < 0{1) ■ OPT, where we 
used Constraint (|23]l to bound the sum. 

Now it just remains to show that only 0(1) iterations of the main loop are necessary. We will 
show that in every iteration at least a c' = ^2(1) fraction of the remaining demands E are satisfied 
in expectation, or equivalently that in expectation the number of remaining unsatisfied demands is 
at most a (1 — c') fraction of the previous number of demands. To see that this is sufficient, note 
that by Markov's inequality with probability at most 1 — c'/2 the number of remaining demands 
is at least a i_].,^2 — c') = 1 — -^Jjj^ fraction of what it was. Equivalently, with probability at 
least c'/2 at least a 12 fraction of demands are covered. Thus the probability that this does 
not happen after (8/c')lnn = 0(1) iterations is at most (1 — d /2)^^/'^ < l/n^. So with high 
probability, after 0(1) rounds the number of unsatisfied demands is at most 1 — iJ]'j2 ^ 1 ~ c'/2 

of what it was. Now if this happens (2/c')lnn = 0(1) the number of remaining demands is at 
most |-E|(1 — c')^^/'^ )\i\-n ^ -|^^ gQ algorithm terminates. Thus with high probability the number 
of iterations is at most (8/c') Inn • (2/c') Inn = 0(1), as required. 

So now we just need to bound the expected number of demands satisfied in a single iteration, 
and show that this is r^di^l). We break this into two cases. If > |-E'|/2, then a 

simple averaging argument shows that at least a 1/3 fraction of the edges {u, G E are included 
in E^^ and since each one clearly covers itself as a demand a total of il(|£^|) demands are covered. 

In the second case we have that i)}6£ '^{^.^} ^ l-^l/^- "^^^ swm. Constraint (124p over all 
demands in E^ giving us 

E E E^^;} = i^i- E -{n,.}> 1^1/2 (26) 
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For each {u,v} G E and w E r(n)nr(t>) and r G L''*, let p^^^^j be the probability that the SmES 
rounding of SmES-LP^(G w) covers {u, i;}. Note that P^^^y is just z^'''' times the probability that 
{u,v} is covered by the SmES rounding of SmES-LPg(GM,) assuming that we actually perform 
this rounding. The expected total number of times edges in E are covered in this phase (with 
repetitions), can be written as follows: 

V V V d"'-^ - V V V o""'^ 



> 



2^ ^0 -^i 2^ ^{«,.}/^0 

weVreL^ {u,v}(^E:u,v&T{w) 



'{u,v} 

{u,v}&E 'wer{u)nr{v) rsL^ 
>n{\E\), hym 



where the first inequality is from the definition of p"^^ and part 4 of Definition 12.11 

Furthermore, we know from the second part of the definition of faithful rounding that P^^^,j < 

^{u,v} — {u,v} — 

toer(n)nr(i>) tsl^ weT{u)nr{v) t<^l^ 

We can then deduce that the probability that we cover demand {ti, G -E (in a single iteration) 
is at least 5 Z^^gr(«)nr(D) Stgl^ simply using the following well-known argument: if t 
(pairwise) independent events occur with probabilities qi, . . . ,qt that sum up to Yll=i Qi ^ then 
by Bonferroni inequality, the probability that at least one of these events occurs is at least 

i i<j i i^j i 

We thus obtain that the expected number of demands covered (in a single iteration) is at least 

{u,v}&E ?«er(u)nr(i;) t&l^ 

which completes the proof. □ 



5 Structure of faithful rounding algorithm for SmES 

We devote the remaining sections to our rounding algorithm for SmES. Given an n- vertex bipartite 
graph G = (Vq, Vi,E), and a solution to the LP relaxatioii2|Bipartite-SmES-LPg(G, ko,ki,do,di), 
our algorithm will give a factor-/ faithful rounding (see Definition 12. ip . for some factor / = 
f{n,kQ,ki,dQ,q) which we define in Section l6.ll Given the parameter q which determines the 

^ We will assume in the remaining sections that the LP solution is normalized. That is, we assume that 1/0 = 1 
(since otherwise, we normalize all variables by defining y'j- = yT/j/0)- 
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size of our LP and hence the running time (as noted earher, these are bounded by vP^'^'^), our 
approximation factor / will be at most 0(7t,^^^^+'-'(^/'?)). 

At a high level, our algorithm finds a carefully chosen collection of (not necessarily induced) 
constant-size subgraphs of G in the form of caterpillars, and then samples vertices and edges from 
the union of these caterpillars according to a very specific distribution^ 

Finally, in Appendix El we give a much simpler faithful rounding algorithm which achieves 
approximation factor do- If it happens that < /, we will run the algorithm described in the 
appendix, and otherwise we will run our main algorithm. Thus, in the remaining sections, we will 
assume throughout that f < cIq. Recall that by convention we assume that ko > ki and thus 
di > f]((io/ log n), so f < do < di log n. 



5.1 A simplified goal 

Let us identify some simplified conditions which are sufficient in order to achieve a factor / faithful 
rounding. We start by weakening the definition of faithful rounding: 

Definition 5.1. A randomized rounding algorithm ^ is a factor- f weakly faithful rounding if there 
is some deterministically chosen (f < 1 (possibly o(l)), such that when given a solution {ya)a£V,E to 
an LP relaxation for SmES on a graph G = {V, E), the algorithm produces a random (not necessarily 
induced) non-empty subgraph H* = {V*,E*) such that 

L Pr[v £ V*] <ipf -Vv for ah v £V, 

2. Pv[{u,v} G E*] < ipy{u,v} for all {u,v} G E, 

3. \V*\ < Iff • J2v£V y^' ('with probability 1), and 

4. E[\E*\]>n(^^-ZiuMeEy{u,v})- 

It turns out that this is equivalent to our original notion: 

Lemma 5.2. For every graph G and LP solution {ya) as above, if there is an algorithm that 
achieves a weakly- faithful factor- f rounding, then there is also an algorithm that achieves a faithful 
factor-0{f) rounding. 

Proof. Run the weakly-faithful algorithm 1/ip times, and take the union of all subgraphs returned. 
A trivial union bound implies that this algorithm satisfies the first three parts of the definition of 
faithful with factor /. To see that it satisfies the fourth part (that the expected number of edges 

is at least Q (^"^^u v}eE y{u,v}^)j Ist P{u,v} denote the probability that the edge {u,v} is included 
in a single iteration. Since P{u,v} ^ W{u,v} ^ '■Pi the probability that {u, v} is included in at least 
one iteration is 1 — (1 — P[u,v}Y^'^ ^ (I ~ c~^)P{u,v}/'P- So by linearity of expectations the expected 
number of edges covered in the union is at least ^^^^Yj{u,v}&eP{u,v} > ^ (j2{u,v}eE y{u,v}) ^ 
required (where the inequality is from part 4 of the definition of weakly faithful). □ 

^As described previously, when used to approximate ld2s the sampled edges are used only in the analysis while 
the sampled vertices are used to buy spanner edges 
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In Section 17. H we will show that our rounding algorithm is faithful, with approximation factor 
determined by the set cardinalities (of subgraph vertices, and of subgraph edges). In other words, 
we show that it suffices to prove an approximation guarantee in the usual sense, and faithfulness will 
follow directly. Anticipating this shift in focus, let us define an even weaker notion of faithfulness 
(which will not be sufficient in general) in terms of set cardinalities: 

Definition 5.3. A randomized rounding algorithm ^ is a skewed proportional rounding with pa- 
rameters {kQ,k[,m') if when given a solution {ya)aev,E to an LP relaxation for SmES with param- 
eters {ko,ki,do,di) on a bipartite graph G = {Vo,Vi, E), the algorithm produces a random (not 
necessarily induced) subgraph H* = {Vq ,V* , E*) such that 

1. Pt[u G Vq*] < ■ vu for all u € Vo, 

2. Fr[v € V{] <^-yv for ah vGVi, 

3. Pr[e £E*]<^-ye for all e e E, 

4. \Vq\ < /cq and \V-^\ < k[ (with probability 1), and 

5. E[|^*|] >nim'). 

As defined, a skewed proportional rounding does not give us any guarantee. The reason for this 
is that the inflation factors relative to the LP values can be different for nodes in Vq and Vi. Namely, 
we might have ^ 7^ Let us determine some sufficient condition on the parameters kQ,k[,m' 
which will guarantee a faithful rounding. Suppose initially, we are given an algorithm which gives 
a skewed proportional rounding where » kof and k'l » kif. We could prune the subgraph, 
by taking a uniformly chosen subset Vq C V^* of size (^o//^o)l^*l' ^ uniformly chosen subset 
V{ C Vi of size {kif /k[)\V{\. The expected number of edges in the remaining subgraph (with 
vertices (VqjVO) is 

/ hf hf 

If this is at least 0(m), then it is easy to see that we have a faithful rounding. However, in the 
general case, this last condition may not be sufficient, since we might have k'^ <^ k^f or k[ <^ kif 
(or both), and then the pruning step does not apply. However, if we also have sufficient average 
degree in H* (without pruning), that is, m' /k'^ > do/f and m' /k[ > di/f, then this is sufficient. 

Lemma 5.4. Suppose we have a skewed proportional rounding with parameters {kQ,k[,m,') which 
satisfy the following three conditions: 

1. m'/k'Q > do/f, 

2. m'/k[ > di/f, 

3- ■%-^^>m = Q{kQdo). 
Then we can also get a faithful factor- f rounding. 
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Proof. Let us consider two cases. 

Case 1: > kof and k[ > kif. In this CctSG, ctS explained above, we can sample random 
subsets of Vq and of the correct size in order to get the correct number of vertices on each 
side (Part 3 of Definition I2.ip . and then by condition ([3]), the number of edges is sufficient (Part 
4 of Definition 12. ip . Note also, that the individual vertex probabilities are appropriately rescaled 
(giving Part 1 of Definition 12. 1|) by the sampling. Finally, let p = ^ • ^ be the subsampling 

probability of edges in E* (i.e. the probability that an edge in E* is retained). If m'p = m, this 
implies both Parts 2 and 4 of Definition 12. li Otherwise, subsample every remaining edge with 
probability m/{m' p), which then guarantees both parts. 

Case 2: k^ < k^f oi k'^ < kif . Without loss of generality, suppose /cg/Zco < k'^/ki. In this 
case, let Vq = V^*, and take a uniformly chosen subset Vl C of size (A;QA;i/(/i;o^i))|^i*|- Thus 
the vertex sets have the correct cardinalities for weakly faithful rounding (with scaling factor 
if = kQ/{kQf)). Since we only pruned on one side (V^), the expected average degree in has 
not changed, which is all we need to show. More formally, the expected number of edges is at 
least m' k'^ki / {k^k'^) > dik'^ki/ [fk^) = mky{fkQ) = ip ■ m, where the inequality follows from 
condition Parts 1 and 2 of Definition 15.11 follow by similar arguments to Case 1. □ 

Corollary 5.5. Given a skewed proportional rounding with parameters {kQ,k[,m'), then denoting 
by d'j, = m'/k'f^ the average degree in (for b = 0,1), the following three conditions suffice for a 
faithful rounding: 

1. < > do/f, 

2. d[ > di/f, 

5. ^ > ^ (for either b = Oorb = l). 

Corollary 5.6. Given a skewed proportional rounding with parameters {kQ,k[,m'), then denoting 
by d'f^ = m'/k'ij the average degree in (for b = 0,1), the following three conditions suffice for a 
faithful rounding: 

1. d'o > do/f, 

2. d[ > di/f, 

3. kl < kbf (for either 6 = orb=l). 

Proof. Follows by substituting the lower bound di-.^/ f for m' /k'^_^ (Condition 1 or 2) in the original 
condition 3, and using /codo = ©(^idi). □ 

5.2 Algorithm description 

Our algorithm is a variation of the non- faithful d/cS algorithm of [BCC"'"10] . and as with their 
algorithm is fundamentally concerned with caterpillar graphs. A caterpillar is a tree consisting of 
a main path (the backbone), with various disjoint paths (hairs) attached by one of their endpoints 
to the backbone. We concentrate on caterpillars with hair-length 1 (single edges). Let us state the 
following definition from jBCC"'"10] . which forms the basic template for the algorithm on graphs 
with maximum degree n''/'^: 
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Definition 5.7. An (r, s)- caterpillar is a tree constructed inductively as follows: Begin with a 
single vertex as the leftmost node in the backbone. For s steps, do the following: at step t, if the 
interval ((t — l)r/s,tr/s) contains an integer, add a hair of length 1 to the rightmost vertex in the 
backbone; otherwise, add an edge to the backbone (increasing its length by 1). 

The algorithm will follow along the above iterative construction of an (r, s)-caterpillar. At 
step t of the construction, we will consider a union of t-edge prefixes of (r, s)-caterpillars in the 
graph G. These will be chosen by an elaborate pruning process described in Section 16.21 which 
will ensure certain uniformity properties while maintaining a large LP weight associated with these 
caterpillars. As part of the pruning process, at step t, we will consider a certain bipartite subgraph 
Gt = {St,Wt, Et), whose edges will come from the union of edges added in step t to the above 
caterpillars (the t'th edge in the construction of each). 

Furthermore, we will consider the tuple of leaves added before the i'th edge in an (r, s)- 
caterpillar. Our bucketing will isolate a set of such leaf tuples Lf, and for every leaf tuple \ £ Lf, 
we will associate a certain subgraph of Gt, whose edges come from the t'th edges in caterpillar 
prefixes whose initial leaves (up to the tth edge) correspond to A. We will write the bipartite graph 

as = {U{H^),W{H^), E{H^)). Note that since we only consider constant size objects, the 
set Lt contains at most a polynomial number of tuples. 

We are now ready to present our algorithm, in Figure [H which will give a skewed-proportional 
rounding satisfying the conditions of Lemma EH (though under certain conditions the rounding may 
also be weakly faithful, or even faithful) . We remind the reader that this algorithm is intended only 
for parameters satisfying f < do (otherwise, we use the much simpler algorithm in Appendix|A]). We 
defer the details of how the above sets are defined to Section 16.21 For now, we only note that they 
can be computed in parallel to the following algorithm, as needed. Our approximation guarantee / 
and parameters r, s (all of which depend on n, ko, ki, do, di, and q) will be defined in Section [6.11 



6 Details of our rounding algorithm for bipartite SmES 

In this section, we give details of our bucketing procedure which defines the various subgraphs used 
in algorithm Faithful- SmES. Moreover, we specify the parameters r,s and our approximation 
ratio / which define the specific caterpillar structure on which our algorithm is based. 



6.1 Parametrization and maximum degree bound 

Given parameters n, kQ,ki,do, di,q, we need to define our intended approximation ratio /, and the 
choice of r and s in the (r, s)-caterpillar which will determine the structure of our graph, and will 
also give an effective bound on the maximum degree. In this section, we define these parameters. 
As before, let q to be the (bounded) integer parameter which corresponds to the level of the Sherali- 
Adams relaxation we use. The running time both for solving the LP and for our rounding will be 
fiOiq) while the approximation guarantee will be 0(n'^~^^+'^(^/'^)). 

Similarly to (BCC+ 10], we would like to choose r and s so that the maximum degree will be 
roughly = n''/* for s < q. In Appendix IbJ we will show that Step [T] of the algorithm gives a 
faithful rounding whenever the maximum degree is greater than D = ^ ■ ^. Thus we would to 
define a = r/s so that 
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Faithful-S?nES(G, {yj}) 

Input: A graph G with LP solution {yi} to Bipartite-SmES-LPg(G, fco, A;i, do, di). 
For steps t = 1, . . . , s: 

1. If the maximum degree in Gt is at least (^f^^ ) do the following, and halt: 

• If 'S'f ^ Vo, choose a subset of kof vertices in St uniformly at random, and choose 
kif vertices in Wt uniformly at random. Otherwise, choose kif vertices in St and 
kof in Wt uniformly at random. Output these vertices. 

• For every edge e = {u, v) whose endpoints are chosen in the previous step, choose 

edge e with probability 7 — — t7- Output these edges. 

\y{u} )y{v} J 

2. Let m' = E^^^^^[\EiH,^)\]. If St C Vo, let k'^ = E^^^~J\UiH,^)\] and k[ = 
E^^^~^^[\W{H,^)\]. Otherwise, let k', = K^^^^^[\W{H,^)\] and k[ = E^^^j^^[\U{H,')\]. 

3. If the parameters m', /cq, k'l satisfy the conditions of Lemma l5.41 choose X £ Lt uniformly 
at random, output H^, and halt. 



Figure 4: Algorithm Faithful-SmES 



We will also need our approximation factor / = f{n, ko, ki,do, di,q) to satisfy the following crucial 
property: 



Note that if we had equality in both (|28p and (j29p . then together, these implicitly define both 
a and /. However, recall that we require a = r / s to he rational (specifically, we will want a to be 
a multiple of 1/q), which most likely would not occur if we had strict equality in (f28j) . To fix this, 
we simply round the implied value of a up to the nearest multiple of 1/q. It is straightforward to 
check that, if we let 7 = log„(A;i/(io), then the new value of a will be 



9(1 + 7/2-^/27 + 774) 



This specific closed-form expression for a is never used in our analysis. It is only important in 
that it guarantees ([28|) . implicitly defines / through (p9]) . and gives the following guarantee, which 
is the precise formulation of (I28p : 



n = _n_ . ^ = „"-0{i/cj) 
kif f 



Proposition 6.1. For f, D and a defined as above, we have 
This implies that 



/ = ni--+0(i/«)do/(A;i/) 
= ^i-"+0{i/9)//i/". by ^ 

Thus, in the worst case, we have the following upper bound on our approximation factor /: 
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Corollary 6.2. For f , D and a defined as above, 

f ^ ^{l-a+0{l/q))a/{l+a) < ^^y. ^{l-a)a/ [l+a)+0[l/ q) ^ ^3-2^2+0(1/^) _ ^0.172+O(l/q) _ 

~ 0<a<l 

Finally, we choose integers r, s such that r and s are co-prime and r/s = a. 
6.2 LP rounding and bucketing 

The fundamental difficulty in adapting LP-hierarchy-based algorithms such as the one in [BCC+10] 
to work in a faithful randomized rounding setting is that the LP values which are finally used in 
finding the actual subgraph are values which arise after several rounds of conditioning. These 
can be markedly different from (or even nearly unrelated to) the original LP values, which we 
want to round with respect to. We get around this problem by limiting our algorithm to vertices 
(and edges, and larger structures) which have roughly uniform LP values (for every specific kind 
of vertex/edge/structure). Thus, even if the values which we use to round are different from the 
original LP values, they are at least uniformly proportional to them. 

In ignoring many vertices/edges/structures in the graph, we have to make sure that we are 
not losing too much of the information given to us by the LP. Since our algorithm and analysis 
ultimately rely on examining caterpillars of a certain form (which is determined by our parameters) , 
the goal of our bucketing of caterpillars is to preserve the total LP weight of such caterpillars in 
our graph, up to a polylogarithmic factor. 

Let K be the template (r, s) caterpillar for r, s corresponding to our parameters (see Defini- 
tion l5.7p and denote by Kt the (t — l)-edge (t-vertex) prefix of this caterpillar (that is, the caterpillar 
constructed inductively as before, for the first t — 1 steps). We will now define a procedure which 
buckets instances in G of these caterpillar prefixes. 

Before describing the procedure, let us introduce one more piece of notation. For a set of 
caterpillars B (a bucket), for every tuple of leaves A (not including the rightmost backbone vertex, 
which may be also be a leaf), denote by T^{B) the set of caterpillars in B which have leaves A (in 
the same order). In addition, for node n, and edge e, denote by T^{B) and the set of caterpillars 
in T^{B) which have u (resp. e) as the final vertex (resp. edge). Note that this edge may be either 
a backbone edge or a hair. An important invariant will be that at the end of every step, the 
cardinalities of sets \T'^{B)\ (resp. |r^(i?)|) will be roughly uniform (up to polylogarithmic factors) 
for every remaining choice of leaf tuple A (resp. leaf tuple A and rightmost backbone vertex u). 

• Initialization: By Constraint (jl3p . X^t,gvb y?j ~ ^^^'^^ vertices in Vq by their LP-value. 
Then there is some bucket Bi for which Xlt^eVb — ^0/ Let us also write Li = 5i = i^i . 

• Step t: Suppose Bt is a bucket of instances of caterpillar Kt in the graph, St is the set of 
rightmost (final) backbone nodes in these caterpillars, and Lt is the set of leaf-tuples occurring 
in these caterpillars (not including the final backbone vertex). Let b € {0,1} be such that 
St C Vf, (this depends only on the parity of backbone edges in Kt). Construct a sequence of 
nested sets of caterpillars in stages as follows: 

— Consider the set of caterpillars Bt formed by taking a caterpillar from Bt and adding 
an edge to the rightmost node. Then up to a logarithmic factor, by (jl4p . for every 
caterpillar K G Bt with rightmost endpoint n, we have YliweT{u)yKvj{{u,w}} = dbUK- In 
particular, this imphes T^ReBt ^/^ = '^'> ' '^KeBt Vk- 
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— Bucket the new caterpillars in Bt so that the following values are uniform (up to a 
constant factor): the LP value of the newly added vertex, of the newly added edge, of 
the leaves together with the new vertex (that is, if the caterpillar originally had leaves 
A and a new vertex w was added, then this is the LP value y\u{w}) and of the entire 
caterpillar. Then the heaviest bucket preserves the total LP weight of caterpillars in 
up to a polylogarithmic factor. Denote this bucket by B'^. 

— Next, bucket the caterpillars in B'^ so that within every bucket, for every tuple of leaves 
A and edge {u,w) the cardinality \T^^^^{Bl)\ is roughly uniform. Again, retain the 
heaviest bucket (which preserves at least a polylogarithmic fraction of LP weight), and 
denote this bucket by B'/ . 

— Now bucket B'/ by the cardinality | T^^^ ^^{B'/)\ (so that this value is roughly uniform 

over the choice of leaf tuple A and new vertex w), and let B'/' denote bucket with the 
largest LP weight. 

— Finally, prune the remaining set of caterpillars B'/' by retaining only those with leaf 
tuples A which satisfy 

^ VK'" > ^{db) ^ VK- 
K"'&T^{Bi") KeT^{Bt) 

Note that for such A, at least a polylogarithmic fraction of the total LP weight of T^{Bt) 
must have also been preserved in each of the previous stages. Denote this set of leaf 
tuples by L^, and let Bt+i ^ B'l' be the corresponding set of caterpillars. 

— Denote by Wt the set of all newly added vertices in caterpillars in Bt+i- That is, 

• Backbone step: If the last edge in Kt+i is a backbone edge, let -L^+i = L^, and let St+i = Wt- 

• Hair step: Otherwise, the last edge in .ftTt+i is a hair. In this case, the rightmost backbone 
vertices in the caterpillars in Bt still belong to St (in each caterpillar that survives the buck- 
eting, it is the same vertex as before the new edge was added). Let Lt+i be the set of new 
leaf tuples of these caterpillars (where each leaf tuple includes the newly added leaf in Wt), 
and let St+i ^ St be the remaining set of rightmost backbone vertices. 

Note that (by induction), if caterpillar Kt rooted in Vq has to edges emanating from side Vq 
and ti edges emanating from side Vi (think of edges as being directed away from the initial node), 
then bucket Bt satisfies 

5^ y^ = e(Mo"4')- (30) 

K&Bt 

which is precisely the number of such caterpillars in a (do , di )-regular bipartite graph (assuming 
we allow degeneracies, such as caterpillars intersecting themselves). 

The following lemma shows that LP weight is preserved even on substructures of caterpillars, 
such as individual vertices and edges. 
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Lemma 6.3. Let B be a set of trees rooted on side Vq and isomorphic to a tree Q which, when 
rooted on side Vq with edges directed away from the root, has to edges emanating from side Vq and 
ti edges emanating from side V\. If the set B satisfies Equation (|30p . then 

• For any vertex i in Q on side (for some b G {0, 1} ), letting Bi be the set of all copies of 
vertex i in trees R € B, we have 

y{v} = Q{h)- 

• For any edge e in Q, letting B^ be the set of all copies of vertex e in trees R £ B, we have 

Proof We give the proof for vertices on side Vq. The proof for vertices on side Vi and for edges 
is similar. Let s = Ylv^B y{v}- By repeated applications of the Sherali- Adams Constraint (fill) we 
have 

YyR<sdl'd{\ 

By (jSOp . this implies that s = i}{kQ). On the other hand, by Constraint (jlSp . we have s < ko, which 
completes the proof. □ 

Remark 6.4. We will take advantage of the bucketing on LP values and other values above to abuse 
notation. For example, since all caterpillars of the form Kt that survive our bucketing will have 
the same LP value (up to a constant factor), we can be a bit imprecise, and write yxtj with the 
understanding that we ignore constant factors in our analysis. 

At step t, for leaf tuple A G Lt, let us define the bipartite subgraph = {U{H^), W{H^),E{H^)) 
as follows. Let 

E{H^) = {{u,w)\T^^^^){Bt+,)^$}, 

and let U{H^) and W{H^) be the vertex sets incident to these edges. That is, U{H^) = {u G 
St \ 3w e Wt : {u,w) G E{H^)}, and W{H^) = {w e Wt \ 3u e U{H^) : {u,w) G E{H^)}. 
This subgraph (for an appropriate choice of t, and distribution over A) will form the basis of our 
rounding algorithm. Later, we will show that the cardinalities of sets involved do not depend on 
the choice of leaves (see Lemma 17. 2p . 

Note that the graphs are subgraphs of the graphs Gt = {St, Wt, Et) which were mentioned 
in Section [5.21 The graph Gt is in fact the union (over leaf tuples A) of all subgraphs H^. The sets 
St and Wt were defined in the above bucketing, while Et is defined as follows: 

Et = {{u,w)\T^^^^^){Bt+i)^%}. 

7 Performance guarantee of our rounding algorithm: faithfulness 
and approximation 

In this section, we show that Algorithm Faithful-SmES gives a faithful /-approximation (using 
Lemma 15. 4p . In fact, if at any iteration the lower bound on degrees in Step [1] of the algorithm 
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is satisfied, then Step [T] already gives a faithful rounding on its own. Otherwise (assuming an 
upper bound on degrees), we show that at some iteration t, Step [3] of the algorithm gives a skew- 
proportional rounding satisfying the conditions of Lemma 15. 4[ 

7.1 LP rounding: faithfulness 

Before we prove the approximation guarantee, we need to show that the algorithm gives a skewed- 
proportional rounding. In fact, this represents the core of our technical contribution. We will show 
that the sampling procedure suggested in StepOof the algorithm always gives a skewed-proportional 
rounding, regardless of whether the conditions of Lemma 15.41 are met. The following lemma allows 
us to reformulate the conditions of skewed-proportional rounding in terms of set cardinalities. 

Lemma 7.1. Let A be an algorithm which, for some t, outputs a random subgraph H* = (Vj,*, V^_^^, E*) 
of Gt = {St-,Wt.,Et) (where b G {0,1} is s.t. St C Vb), where the cardinalities \Vq\,\Vi\,\E*\ are 
roughly uniform (over the randomness). If the following conditions hold: 

1. For all u G St, Vt[u G V^] = 0(E[|T4*|]/|5t|), 

2. for all w G Wt, Vv{w G Vl_^\ = d{E[\V,%\]/\Wt\), and 

3. for all e G Et, Pr[e G E*] = d{¥.[\E*\]/\Et\), 

then algorithm A is a skewed proportional rounding with parameters (0(E[|V^*|]), 0(E[|y]*|]), r2(E[|£'*|])). 

Proof. Follows directly from the definition of skewed proportional rounding, and the fact that, 
by bucketing and by Lemma [6.31 for all u G 5f, u; G Wt and e G Et we have = 0(/cfe/|S'i|), 
= Q{ki_b/\Wt\), and = ^{m/\Et\). □ 

Our goal is thus to show three simple lemmas corresponding to the above conditions. One each 
for the probability of a vertex/edge belonging to U{H^), W{H^), and E{H^) (for uniformly chosen 
A G Lt). First, let us show that, indeed, the cardinalities of these sets (and others) do not vary by 
more than a polylogarithmic factor over the choice of leaf-tuple A. 

Lemma 7.2. For every step t in the above bucketing, the cardinality of both of the following sets 
(when non-empty) does not vary by more than a polylogarithmic factor over the choice of leaf tuple 
X G Lt and rightmost vertex u: 

T\Bt), T^{Bt). 

Moreover, the cardinality of each of the following sets also does not vary by more than a polyloga- 
rithmic factor over the choice of leaf tuple A G Lt: 

U{H^), W{H^), E{H^). 

Proof. We proceed by induction. For t = 1, by definition, for every t; G -Li we have T'"{Bi) = {u}, 
and T^{Bi) = {v} iff -y = n (otherwise it is empty). 

Let us now assume that the lemma holds for T^{Bt) and T^{Bt) (over the choice of A G Lj), 
and show that it holds for U{H^), W{H^), E{H^) (overjhe choice of A G Lt), and for T^' (Bt+i) 
and T^, (-Bi+i) (over the choice of A' G Lt+i). Let A G be a tuple of leaves. As noted earlier 
(see definition of Lt), for any AG Lt, at least a polylogarithmic fraction of the total LP weight of 
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T^{Bt) must have been preserved in each stage of the bucketing. Since by the inductive hypothesis, 
the cardinahty \Tl^{Bt)\ is roughly uniform (up to a poly logarithmic factor), and since LP values of 
caterpillars in Bt are roughly uniform, every vertex u with non-empty T^{Bt) contributes roughly 
the same LP weight to the total weight of T^{Bt), and therefore a 0(1) fraction of these vertices 
must also survive the bucketing. In particular, this implies that 

\U{H,')\ = e{\{u G St I T^^iBt) / 0}|) = e{\T\Bt)\/\T::{Bt)\). (31) 

Since by the inductive hypothesis, the two values in the final ratio on do not depend on A, uq (by 
more than a polylogarithmic factor), the claim follows for U{H^). 

Next, let us show uniformity of the cardinalities W{Hf') and E{Hi). By construction, we have 

Since by construction of S", every edge {u,w) € E{H^) participates in the same number of cater- 
pillars in T^{Bt^i) (up to a constant factor), call it \T^{BtJ^i)\, we have that 



^yK,^,\T,HBt+i] 

which does not depend on A, since all the values in the final expression are fixed by bucketing. By 
a similar argument (by construction of B'/'), every vertex w S W{HI') has the same degree in H}" 
(up to a constant factor). Thus, since the number of edges in is fixed (up to a polylogarithmic 
factor), so is \W{H^)\. 

Finally, we need to show the uniformity of (Bt^i) and T^, (i?(+i) (over the choice of A' G Lt-\-i 
and u' such that T^, (-Bt+i) / 0). Let us consider the two different kinds of steps separately. If t 
is a backbone step, then by the bucketing that defines B'/', the number of caterpillars \T^{Bt-^-l)\ 
is fixed up to a constant factor. Moreover, {w G St+i \ T,^{Bt+i) / 0} = W{H^), and as we've 
shown, the number of vertices w in the latter set is fixed up to a polylogarithmic factor, therefore 
the same holds for the total number of caterpillars |T'*'(St_|_i)| = ^^w^wiH^) \'^w{Bt+i)\- 

Now, suppose t is a hair step. As we've noted, for every {u,w) € E{H^), the number of 
caterpillars \T^^^{Bt+i)\ is fixed up to a constant factor. However, recall that in a hair step we 

have _^^{Bt+i) = Tu'~'^'^\Bt-^i). Thus, it only remains to show the claim for \T'^'^^^'^ {Bt+i)\ = 

Ylu&T x{w) \'^u'~'^^\Bt+i)\. But here it is clearly sufficient to show that every vertex w G W{H^) 



H 



has roughly the same degree in H^, which we have already argued. □ 

Before we state and prove the three main lemmas which we need for the probability bounds 
in Lemma 17. H let us introduce the following notation. Let us assume that when caterpillar Kt 
has its initial vertex at side Vq with edges directed away from the initial vertex, it has to outgoing 
edges from side Vq and ti outgoing edges from side Vi (thus to + = t — 1). For concreteness, 
let us assume that has an even number of backbone edges. That is, when the initial backbone 
vertex is in Vq so is the rightmost vertex. The other case (when the backbone has odd length) 
is quite similar. We are now ready to prove the remaining lemmas which will guarantee skewed 
proportionality. 
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Lemma 7.3. For uniformly chosen X G Lt, for every u ^ St we have Vt\[u G U{H^)] = 
d{\U{Ht)\/\St\). 

Proof. As we have argued earlier, we have Ylxiz-Z^ YlKeT'^iBt) ~ ^{kod^o d!^)- By bucketing, we 
can write this more simply as 

\Lt\\T\Bt)\yK, = ^{kodl°dl'). (33) 
Now, take any vertex u £ St- By repeated applications of Constraint (I14p . we have 



By Lemma [7.21 for any X £ Lt such that U{H^) B u, the number of caterpillars this tuple of leaves 
contributes, \T^{Bt)\, is roughly uniform (up to a polylogarithmic factor). Thus, we have 

\{XGLt\UiH,^)Bu}\\T^{Bt)\yK,^ Y E Vk < d'^>d\^y^. 

\(iLt:U{H^)^uK<=iTi{Bt) 

By Constraint (fT3]) and bucketing, we have y„ = 0{kQ/\St\)-, so the above inequality implies 

|{A G Lt I U{H^) B u}\\T^{Bt)\yK, = 0{kodl°d\^ /\St\). 
Combining this with ([33]). we have 



^ |{A £ Lt I UjH,') B u}\ 
\Lt\ 



kodl'd\^/{\St\\T^{Bt)\yKj 

hd'^^d'-/{\T>^{Bt)\yKj 
\T\Bt)\/\T^{Bt 



O 

°- \s, 

which by (j3ip is what we needed to prove. □ 

Lemma 7.4. For uniformly chosen X € Lt, for every w G Wt we have Prx[w € W{Hf)] = 
d{\W{Ht)\/\Wt\). 

Proof. The proof is similar to that of Lemma 17.31 For A G Lt, let us denote by T^''"(i?t+i) the 
set of caterpillars in Bt+i which have leaves A and w. That is, if t is a backbone step, then 
r^''"(St+i) = T^{Bt+i), and otherwise (if t is a hair step), then T^^'"{Bt+i)= T^^'"{Bt+i). Noting 
that in both cases, the cardinality of this set is roughly uniform for all X & Lt and w G W{H^), let 
us abuse notation and write [T^'"^! for the cardinality of such sets. As argued earlier, the degrees of 
all w G W{H^) in are roughly uniform, and each edge {u,v) G E{H^) participates in roughly 
the same number of caterpillars. Thus, it follows that 

\W{Ht)\ = G{\T\Bt+MT''^'"{Bt+^)\). (34) 

Analogously to (|33p . we can also show 

\Lt\\T\Bt+i)\yK,+, = nikodl°^'d\'). (35) 
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Now, take any vertex w G Wt- By repeated applications of Constraint (jl4p . we have 

5^ yK< A:o<°d*^+^ 

As before, for any \ ^ Lt such that W{H^) B w, the number of caterpillars this tuple of leaves 
contributes, |T^'"'(St)|, is roughly uniform (up to a polylogarithmic factor). Thus, we have 

|{A G Li I WiH^) 3 w}\\T'''"iBt+i)\yK,^, ^ E E ^ 4'd\^^\^. 

X£Lt:W(H^)5w K&T>'-^' [Bt+i] 

By Constraint (fT3]) and bucketing, we have = 0(fci/|VFt|), so the above inequality implies 

|{A G It I 3 w}\\T^^^{Bt+^)\yK,^, = 0{hd'^ d\^^^ /\Wt\). 

Combining this with (|35p. we have 



Pr[u; G )] 



|{A G Lt I 9 w}\ 



O 



\Lt\ 

' k^dl^d\^+^/{\Wt\\T^^^{Bt+i)\yK,+:, 
kod'^^^U\^/{\T\Bt+i)\yK,^,) 



~ ( \T\Bt+i)\/\T^''^{Bt+i)\ \ v., 
= O 1^ j , (smce fcodo ~ feidi) 

which by (j34p is what we needed to prove. □ 
Lemma 7.5. For uniformly chosen A G Lt, for every e € Et we have PTx[e G E{H^)] = 

dmHt)\/\Et\). 



Proof. Take any edge e ^ St- By repeated applications of Constraint (jl4p . we have 

E E - 4°4'ye- 

\&Lt:E{H^)^e K(iTt{Bt) 

As before, for any X ^ Lt such that E{Ht) 3 e, the number of caterpillars this tuple of leaves 
contributes, |Tg'^(i?t4.i)|, is roughly uniform (up to a polylogarithmic factor). Thus, we have 

\{X€Lt\e€E{H^)}\\T^\Bt+,)\yK,+,^ E E yK<dl'd{^y,. 

By Constraints (fTSl) and (fill) and bucketing, we have ye = 0{kodQ/\Et\), so the above inequality 
implies 

|{A G Lt I E{H^) 3 e}\\Te\Bt+i)\yK,^, = O{kodl'+'d{^ /\Et\). 
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Combining this with (j35p . we have 



o 



o 



\Lt\ 

koSt^d\^ /{\Et\\TXBt+^)\yK,^:, 
\THBt+i)\/mBt+,] 



\Et\ 

which by ([32|) is what we needed to prove. □ 
7.2 LP rounding: approximation guarantee 

The analysis of the approximation guarantee is similar to the combinatorial analysis of Dks in [BCC"'"10 



adapted to SmES and slightly simplified by the regularity of degrees and LP values which we get 
from bucketing. 

Let us extend the previous notation by letting S"^ be the set of vertices in St which serve 
as rightmost endpoints of caterpillars in T'^{Bt). We will show that a certain invariant on the 
cardinalities and total LP values of the sets is maintained at every step t, as long as the required 
conditions for faithful rounding (i.e., the conditions for Step [T] or for Step [3] of the algorithm) do 
not hold. The proof works by showing that if the invariant holds after the last iteration, then we 
have arrived at a contradiction. We will consider separately backbone steps and hair steps. Let us 
begin with backbone steps. 

Lemma 7.6. Suppose at iteration t of Algorithm Faithful-SmES the vertices in St are on side b 
(where b € {0, 1}). Let A € Lj. Then if for some f3 < 1 — a the following two conditions hold 

1. \St\yKt/yx = • /^^") (where Kt is any caterpillar in Bt), and 

2. \Sl\ = O(n^), 

then either the conditions for Step [7] hold, or the conditions for Step hold, or the following 
conditions hold: 

1. \S^_^i\yKt+i/yx > 2 • ^ • f(l^+'^y°^ (where Kt+i is any caterpillar in Bt+i), and 

2. |5i\i| = 0(n/5+°). 

We note that the last iteration (iteration s) of the algorithm is always a backbone step (by 
our construction). We will show, in the end, that at the last step we have /? = 1 — a, and thus 
(assuming we do not get a faithful factor 0(/) rounding at any point), the above lemma guarantees 
that \S)^^\yK^^Jyx > 24 -/(i"")/" = 24(fci-6/M)'-" = 2db{ki.bf /db)/ f = 2k,^b. Taking K^+i 
to be the caterpillar in B^_^_i with the smallest yXs+i value, we get that 



XI ^AuM/yA > |5'^+i|yx,+i/yA > 2fci- 



contradicting Constraint (jl3|) . Let us now prove the above lemma. 
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Proof of Lemma \ 7. 6[ By our construction, we know that for a J7(l)-fraction of vertices u ^ S^, 
there is some caterpillar Ku G T^{Bt) such that 

In particular, this gives the following bound on the total "relative LP value" of edges: 

E 2/i^.u{K«,)}/yA = f^(^-/^/"). (36) 

By Lemma IB. 21 and Proposition 16. H we may assume that all the degrees in Gt = {St,Wt, Et), 
and thus also in H^, are at most D = O{ndo/{kif'^)) = 0{n"'), and therefore \St+i\ < l^fl • D = 
0{Cn^'^'^). Thus, in this case, we only need to prove that (there exists a faithful factor / rounding 
or) \S^_^i\yKt+i/yx > 2 • y • f((^+")/°^. Suppose the latter condition is not satisfied. Then by (f36]) . 
the average degree in of vertices in W{H^) is at least 

. //"/(^ . = h{di^,/f). 

Since, as is easy to see, the average degree of vertices in U{H^) is Vl{d}y) > (}{dh/ f), by Corollarv l5.6l 
it suffices to show that \U{H^)\ = 0{ki)f) (and then by the corollary, there is a faithful factor / 
rounding). However, this follows directly: 

\U{H^)\ < \S^\ <n^ < polylog(n) • < polylog(n) • n^"" 

< polylog(n) • kbf'^/di-b by Proposition (16. ip 

< polylog(n) • kbf. 

□ 

We also have the following lemma for hair steps: 

Lemma 7.7. Suppose at iteration t of Algorithm Faithful-SmES the vertices in St are on side b 
(where b G {0, 1}). Let A € Lf. Then if for some /3 > 1 — a the following two conditions hold 

1. \Si\yKt/y\ = ^^(-y-^ • /^^°) (where Kt is any caterpillar in Bt), and 

2. \Sl\ = O(n^), 

then either the conditions for Step [7] hold, or the conditions for Step hold, or the following 
conditions also hold for all leaf tuples X' G Lt+i which extend X: 

^- \St+i\yKt+i/y\' = f^(^y^ • /('^~(^~°))/") (where Kt+i is any caterpillar in Bt+i), and 

2. < in^- 

Proof. As in the proof of Lemma 17.61 the bound on the total "relative LP value" of edges given 
by ([36]) holds. By Constraint p^ . we also have ^yjiz\\r[H^)y^yj{w}/y\ ^ ^i-fo- Together, these 
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inequalities give us the following lower bound on the average "LP-degree" of vertices w S W{Ht) 
(which by our construction is uniform up to a constant factor): 

E/„, ^ 1 dpdi fP/a 

yKuU{u,w)/ y\U{w} ^ polylog(n) ' /fci_b " -I 

u:{u,w)£E(H>^) 

1 di-b f{l3-{l-a))/a ( dt fl/a\ ^07^, 

polylog(n) / / Ui-i>/ ■' ' ^ ' 

1 . d.l~b . f{l3-{l~a))/a 
polylog(n) / 



Thus, condition [T] always holds. Thus, we need to show that, if there is no faithful factor / rounding, 
the average degree (in fact maximum degree, but these are only a constant factor apart) in of 
vertices w £ W{Hf) is at most ^n^~^^~°'\ Suppose not. That is, suppose the average degree of 
such vertices is Q{n^~^^~°'^), and let us show that we can get a faithful rounding of factor /. 

Note that by ([STD, the average degree is at least ■ /{/^-(i-"))/") > f^(^). Since, as 

before, it is easy to see that the average degree of vertices u G U{H^) is at least Q{dh) > Q{dh/f), 
by Corollary 15.51 we only need to show that di_f^/\U{H^)\ > (io/(A;i/^), where d[_jj denotes the 
average degree of vertices w e W{H^). Indeed, by our assumption about this average degree, we 
have 



\U{Hl)\ 

where the last inequality follows from Proposition (j6.1|) . □ 

Combining these two lemmas, the main theorem easily follows: 

Theorem 7.8. (Assuming f < do,) Algorithm Faithful-SmES gives either a factor f faith- 
ful rounding for SmES, or it gives a skewed proportional rounding satisfying the conditions of 
Lemma\5.x 



Proof. Denote by ht the side which contains the vertices in St- The theorem follows from the 
following simple claim, which can be proved directly by induction using the above lemmas (we use 
the notation {x} = x + 1 — \x'\): 

Claim 7.9. Suppose the conditions for Step\^ never hold. Then for all t = 2, . . . , s + 1, either the 
conditions for SteplM hold at at least one of the iterations through step t — 1, or we have 

1. \Sl\yKt/y\ = ^{^^ ■ /{(*-iM/°) (for all A G Lt, and caterpillar Kt G T^{Bt)), and 

2. =0(ni{*-iM). 

Moreover, if {(t — l)a} > a (i.e. step t — 1 was a backbone step), then 

As pointed out earlier, this last inequality yields a contradiction for t = s + 1. Therefore one of 
the steps gives a factor-/ faithful rounding. □ 
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8 Discussion and Future Directions 



Some features of our techniques might be apphcable to other problems. Most obviously, this is 
perhaps the first time that LP hierarchies are applied to "local" parts of an LP, rather than to the 
entire LP. Can this approach be useful for other problems? Currently, it is not clear to us how 
this approach fares against one "global" application of an LP hierarchy to some basic relaxation: 
a global hierarchy could take advantage of non-locality in the constraints and solution, but on the 
other hand would not allow us to locally "guess" degrees (see e.g. footnote U]) . 

Persistent gaps in the approximability of other network design problems naturally call for a 
judicious use of LP hierarchies in order to obtain better approximation algorithms. For example, 
the BASIC A;-SPANNER problem, in which the goal is to construct a /c-spanner with as few edges 
as possible, is only known to admit approximation ratio 0{'n}'^/'^^^'^^^) [ADD"*" 93] . while the best 
hardness of approximation is 2^^°^^ ~n)/k arbitrarily small constant e > |DKR12] . An inte- 
grality gap that almost matches the upper bound (namely a gap of n^(Vfc)) 

was recently shown by 

Dinitz and Krauthgamer [DKllaj . but stronger relaxations obtained via hierarchies can possibly 
have smaller integrality gaps. In particular, it is not at all clear what the best achievable approx- 
imation ratio is for the regime when k is constant; perhaps hierarchies will finally allow upper 
bounds that beat |ADD+93] . Similarly, for directed /c-spanner the known upper bound is 0{\/n) 
[BBM^ iT] ■ and there is an j7(n^/^) integrality gap [DKllaj . but it only applies to a simple LP 
relaxation. Yet other relevant problems are Directed Steiner Tree and Directed Steiner 
Forest, see |FKN09l iBBM+lT] and references therein. Perhaps hierarchies could help for any of 
these problems? 

Finally, the connection we show between ld2s and SmES suggests an intriguing possibility for 
conditional lower bounds. The current hardness for ld2s is only r2(logn), while SmES is basically 
as hard as d/cS, which is commonly thought to be difficult to approximate well (say within a 
polylogarithmic factor, although current hardness results rely on various complexity assumptions 
and give only a relatively small constant |Fei021 IKho06j ). A reduction in the other direction, 
i.e. from SmES to ld2s, could give partial evidence that ld2s cannot be approximated well, and 
could possibly even match the upper bound that we prove here. The same arguments about a 
formal connection to nks obviously apply also to other network design problems, such as BASIC 
fc-SPANNER. 
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A Handling small degrees 

Just as in [BCC+ 10], we may assume that the subgraph degrees (in the optimum, or according to 
the LP) are greater than or equal to our desired approximation ratio /. The reason is that there 
is always a simple do-^PProximation (recall our convention that do < di). Thus if do < /, we are 
done. 

Lemma A.l. There exists a faithful rounding with factor 0{dQ). 

Proof. Consider the following algorithm. Divide all edges in the graph into buckets by their LP- 
values, and also by the LP values of their endpoint vertices (so that all three parameters are 
uniform up to a constant factor within each bucket). Then there is some bucket B for which 
SeS-B ye — ^{fn)- For 6 = 0, 1, let [7^ be the set of vertices on side h which have at least one edge 
in B incident to them. Now pick a subset U'l C Ui of size ki uniformly at random, and let B{U[) 
be the set of edges in B incident to vertices in U[. Finally, choose B' C B(U[) of size 

(38) 

uniformly at random. We return the graph induced by the edges in B'. 

Note that by uniformity of LP values in B, every edge e £ B has LP weight ye = @{m/\B\). 
Moreover, since by Constraint (I14p . vertices on side b (for 6 = 0, 1) all contribute LP degree (that 
is, the LP weight of its incident edges divided by its LP value) @{db), then the LP weight of every 
vertex u £ Ub is Q{kf,/\Ub\)- For brevity, let us omit polylogarithmic factors in the remaining 
discussion. Note that since for any vertex u and edge e incident to u we have ye ^ Uu, this implies 

m k-i , , 

w\ - m- 

which also shows that the quantity in (|38p is at most |i?(C/()|. 

For vertices ui £ Ui, the probability that ui £ U[ is ki/\Ui\ = yui- This, together with the 
fact that \U[\ = ki gives faithfulness for vertices in Ui even for approximation factor 1. Moreover, 
for any edge e £ B, the probability that e £ B{U[) is also A:i/|f7i|. Conditioned on e € -B, the 
probability that e is retained in B' is ■ and thus the probability (a priori) that we will have 
e £ B' is m/\B\ = ye, which gives faithfulness for edges. 

Next, we would like to show that at most m edges are chosen, which will also give the required 
bound on the number of vertices in Uq chosen, since m = d^kQ. Note that since the LP degree of 
every vertex ui £ Ui is at most di, by the LP values of edges and vertices in B, this implies that 
the graph degree of every vertex in Ub (for 6 = 0, 1) is at most 

A = *-^. (40) 

m/\B\ 
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Thus, the total number of edges in B(U[) is always at most \U[\ ■ (iiA;i|i?|/(|[/i|m). By ()38p . the 
number of edges in B' is then always at most \U[ \ ■ di = kidi = m. 

It remains to analyze the probability that an individual vertex in Uq is chosen. Since every 
vertex uq E Uq is picked iff one of its incident edges is included in B' , and since the probability of 
each such event is at most ye, by a union bound, and by (j40p . the probability that uq is picked is 
at most 

ko/\Uo\ , ko/\Uo\ m ko 



DoVe = do 77— ■ye = do --— ■ — = do ■ jj—r = do • Vuo- 

m/\B\ m/\B\ \B\ \Uo\ 



□ 



B Bounding the maximum degree 

It remains to show the correctness of Step [1] in Algorithm Faithful-SmES. Before we do this, let 
us start with a simple claim. 

Claim B.l. In the graph Gt, the average degree and maximum degree of vertices in Wt differ by 
at most a poly logarithmic factor (and the same holds for vertices in St). 

Proof. Let us show this for Wt (the proof for St is identical). By Lemma 16.31 the LP degree 
of the average vertex w £ Wt (that is, the quantity '^u-{uw)eEty{u,w}/y{w}) is ^(^^i)) and by 
Constraint (jl4p no LP-degree (for vertices in Wt) can be more than di. Moreover, by uniformity 
of LP values, the LP-degrees are proportional to the graph degrees, which proves the claim. □ 

Lemma B.2. If at any iteration t Algorithm Faithful-SmES, the maximum degree in Gt is at 
least il. (^-^^^ , then Step{l\ gives a faithful factor- f rounding. 

Proof. Without loss of generality, assume 5^ C Vq (the case where St ^ Vi is essentially the same). 
By Lemma 16.31 and uniformity of LP values (which we get from bucketing) , we have that for every 
vertex u £ St, y^^y ~ ko/\St\, for every vertex w G Wt, yj^i, ~ A;i/|T4^t|, and for every edge e G Et, 
y{e} ~ rn/\Et\. 

Thus, it is clear that the random sampling of vertices in Step[T]is faithful with respect to vertices. 
It suffices, then, to show that every edge e £ Et is picked with probability G(y|e}) (this is sufficient 
since they have total LP weight ^}{m)). Indeed, since every vertex vGStD Wt is chosen with 
probability Q{y{v}f), the probability that both endpoints of an edge in e = {u,w) G Et are chosen 
is @{y{u}y{w}f'^)- Hence we only need to show that this probability is at least y{e}. This follows 
since, by the maximum degree bound, and by Claim \BA\ we have that (ignoring polylogarithmic 
factors): 

|£'|>|VF| ~ ~ '^"^ > 1*^*'"^ ~ ~ y{e}\Et\ 

hf^ y{w}P y{w}Pko ~ yiwjf^ko y{u}y{w}P y{u}y{w}P' 

□ 
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